Nov 04 18:42:16 devstack cinder-volume[76037]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 04 18:42:16 devstack cinder-volume[76037]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 04 18:42:16 devstack cinder-volume[76037]: we strongly recommend against using it for new projects. Nov 04 18:42:16 devstack cinder-volume[76037]: If you are already using Eventlet, we recommend migrating to a different Nov 04 18:42:16 devstack cinder-volume[76037]: framework. For more detail see Nov 04 18:42:16 devstack cinder-volume[76037]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 04 18:42:16 devstack cinder-volume[76037]: import eventlet # noqa Nov 04 18:42:19 devstack cinder-volume[76037]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76037) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 18:42:19 devstack cinder-volume[76037]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76037) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 18:42:19 devstack cinder-volume[76037]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76037) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 18:42:20 devstack cinder-volume[76037]: INFO dbcounter [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Registered counter for database cinder Nov 04 18:42:20 devstack cinder-volume[76037]: DEBUG oslo_db.sqlalchemy.engines [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76037) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG dbcounter [-] [76037] Writer thread running {{(pid=76037) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 18:42:21 devstack cinder-volume[76037]: INFO cinder.rpc [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 04 18:42:21 devstack cinder-volume[76037]: INFO cinder.rpc [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_db.sqlalchemy.engines [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76037) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:42:21 devstack cinder-volume[76037]: INFO cinder.volume.manager [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Determined volume DB was empty at startup. Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG cinder.volume.manager [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76037) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 04 18:42:21 devstack cinder-volume[76037]: INFO cinder.volume.manager [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 04 18:42:21 devstack cinder-volume[76037]: WARNING stevedore.named [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 04 18:42:21 devstack cinder-volume[76037]: WARNING castellan.key_manager [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 18:42:21 devstack cinder-volume[76037]: WARNING cinder.keymgr.conf_key_mgr [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG cinder.volume.drivers.lvm [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76037) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_concurrency.processutils [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_concurrency.processutils [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] CMD "cinder-rtstool verify" returned: 0 in 0.466s {{(pid=76037) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_db.sqlalchemy.engines [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76037) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:42:21 devstack cinder-volume[76037]: INFO cinder.rpc [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 04 18:42:21 devstack cinder-volume[76037]: INFO cinder.rpc [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 04 18:42:21 devstack cinder-volume[76037]: WARNING stevedore.named [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 04 18:42:21 devstack cinder-volume[76037]: WARNING castellan.key_manager [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 18:42:21 devstack cinder-volume[76037]: INFO cinder.volume.manager [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_db.sqlalchemy.engines [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76037) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:42:21 devstack cinder-volume[76037]: INFO oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Starting 1 workers Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Started child 76195 {{(pid=76037) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Full set of CONF: {{(pid=76037) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] ******************************************************************************** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Configuration options gathered from: {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 04 18:42:21 devstack cinder-volume[76195]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] ================================================================================ {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] allow_availability_zone_fallback = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] allow_compression_on_image_upload = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] allowed_direct_url_schemes = [] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] api_rate_limit = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] auth_strategy = keystone {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] az_cache_duration = 3600 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_availability_zone = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_host = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_name = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_stats_polling_interval = 60 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backup_api_class = cinder.backup.api.API {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backup_name_template = backup-%s {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backup_use_same_host = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backup_use_temp_snapshot = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] chap_password = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] chap_username = {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cinder_internal_tenant_project_id = 9b968ffa3f70408ab1facb5b26e6440f {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cinder_internal_tenant_user_id = acee065e482646f69038dc7efd277797 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cloned_volume_same_az = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cluster = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] compression_format = gzip {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] compute_api_class = cinder.compute.nova.API {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] config_dir = [] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] config_source = [] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] control_exchange = openstack {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] debug = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] default_availability_zone = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] default_group_type = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] default_volume_type = lvmdriver-1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] disk_geometry = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] driver_client_cert = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] driver_client_cert_key = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] driver_data_namespace = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] driver_ssl_cert_path = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] driver_ssl_cert_verify = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] driver_use_ssl = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] enable_force_upload = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] enable_new_services = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] enable_unsupported_driver = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] enforce_multipath_for_image_xfer = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:21 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] filter_function = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] glance_api_insecure = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] glance_api_servers = ['http://192.168.122.50/image'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] glance_api_ssl_compression = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] glance_ca_certificates_file = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] glance_catalog_info = image:glance:publicURL {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] glance_certfile = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] glance_keyfile = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] glance_num_retries = 3 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] glance_request_timeout = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] goodness_function = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] graceful_shutdown_timeout = 5 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] group_api_class = cinder.group.api.API {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] host = devstack {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] image_compress_on_upload = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] image_conversion_address_space_limit = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] image_conversion_cpu_limit = 60 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] image_conversion_disable = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] image_introspection_address_space_limit = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] image_introspection_cpu_limit = 60 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] image_upload_use_cinder_backend = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] image_upload_use_internal_tenant = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] image_volume_cache_enabled = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] image_volume_cache_max_count = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] image_volume_cache_max_size_gb = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] init_host_max_objects_retrieval = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] instance_format = [instance: %(uuid)s] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] iscsi_target_flags = {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] iscsi_write_cache = on {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] iser_helper = tgtadm {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] iser_ip_address = 192.168.122.50 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] iser_port = 3260 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76195]: INFO cinder.volume.manager [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 04 18:42:22 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] log_color = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] log_config_append = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] log_dir = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] log_file = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] log_options = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] log_rotate_interval = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] log_rotate_interval_type = days {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] log_rotation_type = none {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] max_age = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] max_logfile_count = 30 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] max_logfile_size_mb = 200 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] max_over_subscription_ratio = 20.0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] message_reap_interval = 86400 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] message_ttl = 2592000 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] migration_create_volume_timeout_secs = 300 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] monkey_patch = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] monkey_patch_modules = [] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] my_ip = 192.168.122.50 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] no_snapshot_gb_quota = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] num_iser_scan_tries = 3 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] num_shell_tries = 3 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] num_volume_device_scan_tries = 3 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] nvmeof_conn_info_version = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] nvmet_ns_id = 10 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] nvmet_port_id = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] osapi_max_limit = 1000 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] osapi_volume_ext_list = [] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] osapi_volume_listen_port = 8776 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] osapi_volume_use_ssl = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] osapi_volume_workers = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] per_volume_size_limit = -1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] periodic_fuzzy_delay = 60 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] periodic_interval = 60 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] public_endpoint = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] publish_errors = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] quota_backup_gigabytes = 1000 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] quota_backups = 10 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] quota_gigabytes = 1000 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] quota_groups = 10 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] quota_snapshots = 10 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] quota_volumes = 10 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] rate_limit_burst = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] rate_limit_except_level = CRITICAL {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] rate_limit_interval = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] reinit_driver_count = 3 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] replication_device = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] report_discard_supported = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] report_interval = 120 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] reservation_clean_interval = 86400 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] reservation_expire = 86400 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] reserved_image_namespaces = [] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] reserved_percentage = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] rpc_response_timeout = 120 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] run_external_periodic_tasks = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] scst_target_driver = iscsi {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] scst_target_iqn_name = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] service_down_time = 720 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] shell_completion = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] snapshot_name_template = snapshot-%s {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] snapshot_same_host = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] split_loggers = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] state_path = /opt/stack/data/cinder {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] storage_availability_zone = nova {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] storage_protocol = iSCSI {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] syslog_log_facility = LOG_USER {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] target_helper = lioadm {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] target_ip_address = 192.168.122.50 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] target_port = 3260 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] target_protocol = iscsi {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] target_secondary_ip_addresses = [] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] trace_flags = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] transport_url = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] until_refresh = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] use_chap_auth = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] use_default_quota_class = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] use_journal = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] use_json = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] use_multipath_for_image_xfer = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] use_stderr = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] use_syslog = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] verify_glance_signatures = enabled {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] volume_api_class = cinder.volume.api.API {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] volume_backend_name = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] volume_clear = zero {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] volume_clear_ionice = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] volume_clear_size = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] volume_copy_bps_limit = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] volume_dd_blocksize = 1M {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] volume_name_template = volume-%s {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] volume_service_inithost_offload = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] volume_usage_audit_period = month {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] zoning_mode = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_concurrency.disable_process_locking = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.auth_section = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.auth_type = password {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.auth_version = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.cache = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.certfile = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.include_service_catalog = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.insecure = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.interface = public {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.keyfile = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.memcache_password = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.memcache_username = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.region_name = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.service_type = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.50/identity {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.backend = dogpile.cache.null {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.backend_argument = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:22 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.backend_expiration_time = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.config_prefix = cache.oslo {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.debug_cache_backend = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.enable_retry_client = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.enable_socket_keepalive = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.enabled = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.expiration_time = 600 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.hashclient_retry_attempts = 2 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.memcache_dead_retry = 300 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.memcache_pool_maxsize = 10 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.memcache_sasl_enabled = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.password = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.proxies = [] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.redis_db = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.redis_server = localhost:6379 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.retry_attempts = 2 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.retry_delay = 0.0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.socket_keepalive_count = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.socket_keepalive_idle = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.socket_keepalive_interval = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.socket_timeout = 1.0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.tls_allowed_ciphers = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.tls_cafile = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.tls_certfile = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.tls_enabled = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.tls_keyfile = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cache.username = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] coordination.backend_url = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] database.asyncio_connection = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] database.asyncio_slave_connection = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] database.backend = sqlalchemy {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] database.connection = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] database.connection_debug = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] database.connection_parameters = {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] database.connection_recycle_time = 3600 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] database.connection_trace = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] database.db_inc_retry_interval = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] database.db_max_retries = 20 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] database.db_max_retry_interval = 10 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] database.db_retry_interval = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] database.max_overflow = 50 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] database.max_pool_size = 5 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] database.max_retries = 10 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] database.mysql_wsrep_sync_wait = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] database.pool_timeout = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] database.retry_interval = 10 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] database.slave_connection = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] database.sqlite_synchronous = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] database.synchronous_reader = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] database.use_db_reconnect = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_tracing.insecure = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] profiler.connection_string = messaging:// {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] profiler.enabled = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] profiler.es_doc_type = notification {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] profiler.es_scroll_size = 10000 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] profiler.es_scroll_time = 2m {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] profiler.filter_error_trace = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] profiler.hmac_keys = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] profiler.sentinel_service_name = mymaster {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] profiler.socket_timeout = 0.1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] profiler.trace_requests = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] profiler.trace_sqlalchemy = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] profiler_jaeger.process_tags = {} {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] profiler_jaeger.service_name_prefix = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] profiler_otlp.service_name_prefix = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_policy.enforce_new_defaults = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_policy.policy_default_rule = default {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack sudo[76206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_policy.policy_file = policy.yaml {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack sudo[76206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] privsep_osbrick.group = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] privsep_osbrick.helper_command = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] privsep_osbrick.user = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cinder_sys_admin.group = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cinder_sys_admin.helper_command = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] cinder_sys_admin.user = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] service_user.auth_section = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] service_user.auth_type = password {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] service_user.cafile = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] service_user.certfile = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] service_user.collect_timing = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] service_user.insecure = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] service_user.keyfile = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] service_user.send_service_user_token = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] service_user.split_loggers = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] service_user.timeout = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] service_user.tls_ciphers = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] service_user.tls_min_version = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] glance.auth_section = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] glance.auth_type = password {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] glance.certfile = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] glance.collect_timing = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] glance.insecure = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] glance.keyfile = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] glance.region_name = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] glance.split_loggers = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] glance.timeout = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] glance.tls_ciphers = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] glance.tls_min_version = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.backend_availability_zone = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.chap_password = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.chap_username = {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.disk_geometry = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.driver_client_cert = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.driver_client_cert_key = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.driver_data_namespace = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.driver_use_ssl = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.extra_capabilities = {} {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.filter_function = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.goodness_function = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.iscsi_target_flags = {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.iscsi_write_cache = on {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.iser_helper = tgtadm {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.iser_ip_address = 192.168.122.50 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.iser_port = 3260 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.lvm_share_target = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.lvm_type = auto {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.num_shell_tries = 3 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.replication_device = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.report_discard_supported = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.reserved_percentage = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.target_helper = tgtadm {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.target_ip_address = 192.168.122.50 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.target_port = 3260 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.target_protocol = iscsi {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.trace_flags = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.unique_fqdn_network = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.use_chap_auth = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.volume_backend_name = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.volume_clear = zero {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.volume_clear_ionice = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.volume_clear_size = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_reports.file_event_handler = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_reports.log_dir = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.backend_host = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.chap_password = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.chap_username = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.disk_geometry = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.driver_client_cert = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.extra_capabilities = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.filter_function = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.goodness_function = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.iser_helper = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.iser_ip_address = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.iser_port = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.lvm_share_target = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.lvm_type = auto {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.num_shell_tries = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.replication_device = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.report_discard_supported = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.reserved_percentage = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.scst_target_driver = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.storage_protocol = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.target_helper = lioadm {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.target_ip_address = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.target_port = 3260 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.trace_flags = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.use_chap_auth = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.volume_clear = zero {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.volume_clear_size = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] lvmdriver-1.volumes_dir = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.ssl = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_notifications.driver = [] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_notifications.retry = -1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] key_manager.fixed_key = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican.barbican_api_version = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican.barbican_endpoint = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican.barbican_endpoint_type = public {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican.barbican_region_name = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican.cafile = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican.certfile = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican.collect_timing = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican.insecure = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican.keyfile = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican.number_of_retries = 60 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican.retry_delay = 1 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican.send_service_user_token = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican.split_loggers = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican.timeout = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican.tls_ciphers = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican.tls_min_version = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican.verify_ssl = True {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican.verify_ssl_path = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican_service_user.auth_section = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican_service_user.auth_type = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican_service_user.cafile = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican_service_user.certfile = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican_service_user.collect_timing = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican_service_user.insecure = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican_service_user.keyfile = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican_service_user.split_loggers = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican_service_user.timeout = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican_service_user.tls_ciphers = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] barbican_service_user.tls_min_version = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] vault.approle_role_id = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] vault.approle_secret_id = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] vault.auth_method = approle {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] vault.auth_path = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] vault.kv_mountpoint = secret {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] vault.kv_path = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] vault.kv_version = 2 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] vault.namespace = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] vault.root_token_id = **** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] vault.ssl_ca_crt_file = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] vault.timeout = 60.0 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] vault.token_file = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] vault.token_role = None {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] vault.use_ssl = False {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:42:22 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] ******************************************************************************** {{(pid=76037) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 04 18:42:22 devstack sudo[76206]: pam_unix(sudo:session): session closed for user root Nov 04 18:42:22 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.347s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:22 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:22 devstack sudo[76338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:42:22 devstack sudo[76338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:42:22 devstack sudo[76338]: pam_unix(sudo:session): session closed for user root Nov 04 18:42:22 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.287s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:22 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 18:42:22 devstack cinder-volume[76195]: INFO cinder.brick.local_dev.lvm [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 04 18:42:22 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:22 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:22 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:22 devstack sudo[76425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:42:22 devstack sudo[76425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:42:23 devstack sudo[76425]: pam_unix(sudo:session): session closed for user root Nov 04 18:42:23 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:23 devstack cinder-volume[76195]: DEBUG cinder.brick.local_dev.lvm [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76195) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 04 18:42:23 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:23 devstack sudo[76504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:42:23 devstack sudo[76504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:42:23 devstack sudo[76504]: pam_unix(sudo:session): session closed for user root Nov 04 18:42:23 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.520s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:23 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:23 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:23 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:23 devstack sudo[76711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:42:23 devstack sudo[76711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:42:23 devstack sudo[76711]: pam_unix(sudo:session): session closed for user root Nov 04 18:42:23 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.335s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:23 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:23 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:23 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:23 devstack sudo[76808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 04 18:42:23 devstack sudo[76808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:42:24 devstack sudo[76808]: pam_unix(sudo:session): session closed for user root Nov 04 18:42:24 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.252s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:24 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:24 devstack sudo[76811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:42:24 devstack sudo[76811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:42:24 devstack sudo[76811]: pam_unix(sudo:session): session closed for user root Nov 04 18:42:24 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.307s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:24 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:24 devstack sudo[76896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:42:24 devstack sudo[76896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:42:24 devstack sudo[76896]: pam_unix(sudo:session): session closed for user root Nov 04 18:42:24 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:24 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:24 devstack sudo[76905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:42:24 devstack sudo[76905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:42:25 devstack sudo[76905]: pam_unix(sudo:session): session closed for user root Nov 04 18:42:25 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:25 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:25 devstack sudo[76922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:42:25 devstack sudo[76922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:42:25 devstack sudo[76922]: pam_unix(sudo:session): session closed for user root Nov 04 18:42:25 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:25 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:25 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:25 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:25 devstack sudo[76998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:42:25 devstack sudo[76998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:42:25 devstack sudo[76998]: pam_unix(sudo:session): session closed for user root Nov 04 18:42:25 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:25 devstack cinder-volume[76195]: INFO cinder.volume.drivers.lvm [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 04 18:42:25 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:25 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:25 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:25 devstack sudo[77002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:42:25 devstack sudo[77002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:42:25 devstack sudo[77002]: pam_unix(sudo:session): session closed for user root Nov 04 18:42:25 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.243s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:25 devstack cinder-volume[76195]: DEBUG cinder.volume.drivers.lvm [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Updating volume stats {{(pid=76195) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 18:42:25 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:25 devstack sudo[77005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:42:25 devstack sudo[77005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:42:26 devstack sudo[77005]: pam_unix(sudo:session): session closed for user root Nov 04 18:42:26 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:26 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:26 devstack sudo[77008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:42:26 devstack sudo[77008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:42:26 devstack sudo[77008]: pam_unix(sudo:session): session closed for user root Nov 04 18:42:26 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:26 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:26 devstack sudo[77012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:42:26 devstack sudo[77012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:42:26 devstack sudo[77012]: pam_unix(sudo:session): session closed for user root Nov 04 18:42:26 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:26 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:26 devstack sudo[77015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:42:26 devstack sudo[77015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:42:26 devstack sudo[77015]: pam_unix(sudo:session): session closed for user root Nov 04 18:42:26 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:26 devstack cinder-volume[76195]: INFO cinder.volume.driver [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Driver hasn't implemented _init_vendor_properties() Nov 04 18:42:26 devstack cinder-volume[76195]: DEBUG cinder.volume.driver [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76195) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 04 18:42:26 devstack cinder-volume[76195]: DEBUG oslo_db.sqlalchemy.engines [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76195) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:42:26 devstack cinder-volume[76195]: DEBUG dbcounter [-] [76195] Writer thread running {{(pid=76195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 18:42:26 devstack cinder-volume[76195]: DEBUG cinder.db.api [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Building query based on filter {{(pid=76195) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 04 18:42:26 devstack cinder-volume[76195]: DEBUG cinder.image.image_utils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76195) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 04 18:42:26 devstack cinder-volume[76195]: INFO cinder.keymgr.migration [None req-79f070f4-2abc-4ad9-a2c2-14c23540e56a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 04 18:42:26 devstack cinder-volume[76195]: DEBUG cinder.volume.drivers.lvm [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Updating volume stats {{(pid=76195) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 18:42:26 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:27 devstack sudo[77018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:42:27 devstack sudo[77018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:42:27 devstack sudo[77018]: pam_unix(sudo:session): session closed for user root Nov 04 18:42:27 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:27 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:27 devstack sudo[77021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:42:27 devstack sudo[77021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:42:27 devstack sudo[77021]: pam_unix(sudo:session): session closed for user root Nov 04 18:42:27 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:27 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:27 devstack sudo[77026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:42:27 devstack sudo[77026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:42:27 devstack sudo[77026]: pam_unix(sudo:session): session closed for user root Nov 04 18:42:27 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:27 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:27 devstack sudo[77029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:42:27 devstack sudo[77029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:42:28 devstack sudo[77029]: pam_unix(sudo:session): session closed for user root Nov 04 18:42:28 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:28 devstack cinder-volume[76195]: DEBUG cinder.manager [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Notifying Schedulers of capabilities ... {{(pid=76195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:42:28 devstack cinder-volume[76195]: INFO cinder.volume.manager [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Driver initialization completed successfully. Nov 04 18:42:28 devstack cinder-volume[76195]: INFO cinder.manager [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Initiating service 2 cleanup Nov 04 18:42:28 devstack cinder-volume[76195]: INFO cinder.manager [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Service 2 cleanup completed. Nov 04 18:42:28 devstack cinder-volume[76195]: DEBUG cinder.service [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Creating RPC server for service cinder-volume {{(pid=76195) start /opt/stack/cinder/cinder/service.py:231}} Nov 04 18:42:28 devstack cinder-volume[76195]: DEBUG cinder.service [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76195) start /opt/stack/cinder/cinder/service.py:237}} Nov 04 18:42:28 devstack cinder-volume[76195]: INFO cinder.volume.manager [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 04 18:42:28 devstack cinder-volume[76195]: DEBUG cinder.volume.drivers.lvm [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Updating volume stats {{(pid=76195) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 18:42:28 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:28 devstack sudo[77036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:42:28 devstack sudo[77036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:42:28 devstack sudo[77036]: pam_unix(sudo:session): session closed for user root Nov 04 18:42:28 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:28 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:28 devstack sudo[77039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:42:28 devstack sudo[77039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:42:28 devstack sudo[77039]: pam_unix(sudo:session): session closed for user root Nov 04 18:42:28 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:28 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:28 devstack sudo[77044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:42:28 devstack sudo[77044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:42:28 devstack sudo[77044]: pam_unix(sudo:session): session closed for user root Nov 04 18:42:28 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:28 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:42:28 devstack sudo[77047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:42:28 devstack sudo[77047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:42:29 devstack sudo[77047]: pam_unix(sudo:session): session closed for user root Nov 04 18:42:29 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:42:29 devstack cinder-volume[76195]: INFO cinder.volume.manager [None req-8e676e66-cf5e-4395-adde-518b57594c49 None None] Driver post RPC initialization completed successfully. Nov 04 18:42:31 devstack cinder-volume[76037]: DEBUG dbcounter [-] [76037] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76037) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:42:39 devstack cinder-volume[76195]: DEBUG dbcounter [-] [76195] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:42:39 devstack cinder-volume[76195]: DEBUG dbcounter [-] [76195] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:43:29 devstack cinder-volume[76195]: DEBUG oslo_service.periodic_task [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76195) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:43:29 devstack cinder-volume[76195]: DEBUG cinder.volume.drivers.lvm [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Updating volume stats {{(pid=76195) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 18:43:29 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:43:29 devstack sudo[79011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:43:29 devstack sudo[79011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:43:29 devstack sudo[79011]: pam_unix(sudo:session): session closed for user root Nov 04 18:43:29 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:43:29 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:43:29 devstack sudo[79014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:43:29 devstack sudo[79014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:43:29 devstack sudo[79014]: pam_unix(sudo:session): session closed for user root Nov 04 18:43:29 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:43:29 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:43:29 devstack sudo[79017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:43:29 devstack sudo[79017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:43:30 devstack sudo[79017]: pam_unix(sudo:session): session closed for user root Nov 04 18:43:30 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:43:30 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:43:30 devstack sudo[79020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:43:30 devstack sudo[79020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:43:30 devstack sudo[79020]: pam_unix(sudo:session): session closed for user root Nov 04 18:43:30 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:43:30 devstack cinder-volume[76195]: DEBUG cinder.manager [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Notifying Schedulers of capabilities ... {{(pid=76195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:43:30 devstack cinder-volume[76195]: DEBUG oslo_service.periodic_task [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Running periodic task VolumeManager._thread_info {{(pid=76195) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:43:30 devstack cinder-volume[76195]: DEBUG cinder.volume.manager [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] thread count: 6 {{(pid=76195) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:43:30 devstack cinder-volume[76195]: DEBUG cinder.volume.manager [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] thread info: [<_MainThread(MainThread, started 137934945243264)>, , , , , ] {{(pid=76195) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:44:29 devstack cinder-volume[76195]: DEBUG oslo_service.periodic_task [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76195) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:44:29 devstack cinder-volume[76195]: DEBUG cinder.volume.drivers.lvm [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Updating volume stats {{(pid=76195) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 18:44:29 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:29 devstack sudo[82361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:44:29 devstack sudo[82361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:44:29 devstack sudo[82361]: pam_unix(sudo:session): session closed for user root Nov 04 18:44:29 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:29 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:29 devstack sudo[82365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:44:29 devstack sudo[82365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:44:29 devstack sudo[82365]: pam_unix(sudo:session): session closed for user root Nov 04 18:44:29 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:29 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:29 devstack sudo[82368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:44:29 devstack sudo[82368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:44:30 devstack sudo[82368]: pam_unix(sudo:session): session closed for user root Nov 04 18:44:30 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.298s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:30 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:30 devstack sudo[82375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:44:30 devstack sudo[82375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:44:30 devstack sudo[82375]: pam_unix(sudo:session): session closed for user root Nov 04 18:44:30 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:30 devstack cinder-volume[76195]: DEBUG cinder.manager [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Notifying Schedulers of capabilities ... {{(pid=76195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:44:30 devstack cinder-volume[76195]: DEBUG oslo_service.periodic_task [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Running periodic task VolumeManager._thread_info {{(pid=76195) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:44:30 devstack cinder-volume[76195]: DEBUG cinder.volume.manager [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] thread count: 6 {{(pid=76195) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:44:30 devstack cinder-volume[76195]: DEBUG cinder.volume.manager [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] thread info: [<_MainThread(MainThread, started 137934945243264)>, , , , , ] {{(pid=76195) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:44:39 devstack cinder-volume[76195]: DEBUG dbcounter [-] [76195] Writing DB stats cinder:SELECT=1 {{(pid=76195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:44:39 devstack cinder-volume[76195]: DEBUG dbcounter [-] [76195] Writing DB stats cinder:UPDATE=1 {{(pid=76195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:45:29 devstack cinder-volume[76195]: DEBUG oslo_service.periodic_task [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76195) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:45:29 devstack cinder-volume[76195]: DEBUG cinder.volume.drivers.lvm [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Updating volume stats {{(pid=76195) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 18:45:29 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:45:29 devstack sudo[84500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:45:29 devstack sudo[84500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:45:29 devstack sudo[84500]: pam_unix(sudo:session): session closed for user root Nov 04 18:45:29 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:45:29 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:45:29 devstack sudo[84514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:45:29 devstack sudo[84514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:45:29 devstack sudo[84514]: pam_unix(sudo:session): session closed for user root Nov 04 18:45:29 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:45:29 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:45:29 devstack sudo[84517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:45:29 devstack sudo[84517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:45:30 devstack sudo[84517]: pam_unix(sudo:session): session closed for user root Nov 04 18:45:30 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:45:30 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:45:30 devstack sudo[84520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:45:30 devstack sudo[84520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:45:30 devstack sudo[84520]: pam_unix(sudo:session): session closed for user root Nov 04 18:45:30 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:45:30 devstack cinder-volume[76195]: DEBUG cinder.manager [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Notifying Schedulers of capabilities ... {{(pid=76195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:46:29 devstack cinder-volume[76195]: DEBUG oslo_service.periodic_task [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76195) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:46:29 devstack cinder-volume[76195]: DEBUG cinder.volume.drivers.lvm [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Updating volume stats {{(pid=76195) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 18:46:29 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:46:29 devstack sudo[85778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:46:29 devstack sudo[85778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:46:29 devstack sudo[85778]: pam_unix(sudo:session): session closed for user root Nov 04 18:46:29 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:46:29 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:46:29 devstack sudo[85783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:46:29 devstack sudo[85783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:46:29 devstack sudo[85783]: pam_unix(sudo:session): session closed for user root Nov 04 18:46:29 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:46:29 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:46:29 devstack sudo[85797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:46:29 devstack sudo[85797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:46:30 devstack sudo[85797]: pam_unix(sudo:session): session closed for user root Nov 04 18:46:30 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:46:30 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:46:30 devstack sudo[85800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:46:30 devstack sudo[85800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:46:30 devstack sudo[85800]: pam_unix(sudo:session): session closed for user root Nov 04 18:46:30 devstack cinder-volume[76195]: DEBUG oslo_concurrency.processutils [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76195) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:46:30 devstack cinder-volume[76195]: DEBUG cinder.manager [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Notifying Schedulers of capabilities ... {{(pid=76195) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:46:30 devstack cinder-volume[76195]: DEBUG oslo_service.periodic_task [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] Running periodic task VolumeManager._thread_info {{(pid=76195) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:46:30 devstack cinder-volume[76195]: DEBUG cinder.volume.manager [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] thread count: 6 {{(pid=76195) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:46:30 devstack cinder-volume[76195]: DEBUG cinder.volume.manager [None req-7e1de230-80b3-436c-b15c-6ad9bfc17fb2 None None] thread info: [<_MainThread(MainThread, started 137934945243264)>, , , , , ] {{(pid=76195) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:46:39 devstack cinder-volume[76195]: DEBUG dbcounter [-] [76195] Writing DB stats cinder:SELECT=1 {{(pid=76195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:46:39 devstack cinder-volume[76195]: DEBUG dbcounter [-] [76195] Writing DB stats cinder:UPDATE=1 {{(pid=76195) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:46:44 devstack cinder-volume[76037]: INFO oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Caught SIGTERM, stopping children Nov 04 18:46:44 devstack cinder-volume[76037]: DEBUG oslo_concurrency.lockutils [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Acquiring lock "singleton_lock" {{(pid=76037) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 18:46:44 devstack cinder-volume[76037]: DEBUG oslo_concurrency.lockutils [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Acquired lock "singleton_lock" {{(pid=76037) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 18:46:44 devstack cinder-volume[76037]: DEBUG oslo_concurrency.lockutils [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Releasing lock "singleton_lock" {{(pid=76037) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 18:46:44 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Stop services. {{(pid=76037) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 04 18:46:44 devstack cinder-volume[76037]: DEBUG oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Killing children. {{(pid=76037) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 04 18:46:44 devstack cinder-volume[76037]: INFO oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Waiting on 1 children to exit Nov 04 18:46:48 devstack cinder-volume[76195]: DEBUG oslo_concurrency.lockutils [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Acquiring lock "singleton_lock" {{(pid=76195) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 18:46:48 devstack cinder-volume[76195]: DEBUG oslo_concurrency.lockutils [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Acquired lock "singleton_lock" {{(pid=76195) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 18:46:48 devstack cinder-volume[76195]: DEBUG oslo_concurrency.lockutils [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Releasing lock "singleton_lock" {{(pid=76195) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 18:46:48 devstack cinder-volume[76195]: WARNING amqp [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 04 18:46:48 devstack cinder-volume[76195]: WARNING amqp [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 04 18:46:48 devstack cinder-volume[76037]: INFO oslo_service.backend._eventlet.service [None req-ccdcde49-c3ac-42ff-9556-edf463e39d52 None None] Child 76195 exited with status 0 Nov 04 18:46:48 devstack cinder-volume[86280]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 04 18:46:48 devstack cinder-volume[86280]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 04 18:46:48 devstack cinder-volume[86280]: we strongly recommend against using it for new projects. Nov 04 18:46:48 devstack cinder-volume[86280]: If you are already using Eventlet, we recommend migrating to a different Nov 04 18:46:48 devstack cinder-volume[86280]: framework. For more detail see Nov 04 18:46:48 devstack cinder-volume[86280]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 04 18:46:48 devstack cinder-volume[86280]: import eventlet # noqa Nov 04 18:46:50 devstack cinder-volume[86280]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86280) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 18:46:50 devstack cinder-volume[86280]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86280) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 18:46:50 devstack cinder-volume[86280]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86280) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 18:46:51 devstack cinder-volume[86280]: INFO dbcounter [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] Registered counter for database cinder Nov 04 18:46:51 devstack cinder-volume[86280]: DEBUG oslo_db.sqlalchemy.engines [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86280) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:46:51 devstack cinder-volume[86280]: DEBUG dbcounter [-] [86280] Writer thread running {{(pid=86280) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 18:46:51 devstack cinder-volume[86280]: INFO cinder.rpc [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 04 18:46:51 devstack cinder-volume[86280]: INFO cinder.rpc [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 04 18:46:51 devstack cinder-volume[86280]: DEBUG oslo_db.sqlalchemy.engines [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86280) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:46:51 devstack cinder-volume[86280]: INFO cinder.volume.manager [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] Determined volume DB was empty at startup. Nov 04 18:46:51 devstack cinder-volume[86280]: DEBUG cinder.volume.manager [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86280) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 04 18:46:51 devstack cinder-volume[86280]: INFO cinder.volume.manager [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 04 18:46:51 devstack cinder-volume[86280]: WARNING stevedore.named [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 04 18:46:51 devstack cinder-volume[86280]: WARNING castellan.key_manager [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 18:46:51 devstack cinder-volume[86280]: WARNING cinder.keymgr.conf_key_mgr [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 18:46:51 devstack cinder-volume[86280]: INFO cinder.volume.manager [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 04 18:46:51 devstack cinder-volume[86280]: DEBUG oslo_db.sqlalchemy.engines [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86280) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:46:52 devstack cinder-volume[86280]: INFO oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] Starting 1 workers Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] Started child 86498 {{(pid=86280) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] Full set of CONF: {{(pid=86280) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] ******************************************************************************** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] Configuration options gathered from: {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] ================================================================================ {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] allow_availability_zone_fallback = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] allow_compression_on_image_upload = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] allowed_direct_url_schemes = [] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] api_rate_limit = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] auth_strategy = keystone {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_availability_zone = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86498]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_host = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_name = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_stats_polling_interval = 60 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backup_api_class = cinder.backup.api.API {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backup_name_template = backup-%s {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backup_use_same_host = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backup_use_temp_snapshot = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] chap_password = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] chap_username = {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cinder_internal_tenant_project_id = 9b968ffa3f70408ab1facb5b26e6440f {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cinder_internal_tenant_user_id = acee065e482646f69038dc7efd277797 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cluster = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] compression_format = gzip {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] compute_api_class = cinder.compute.nova.API {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] config_dir = [] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] config_source = [] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] control_exchange = openstack {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] debug = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] default_availability_zone = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] default_group_type = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] default_volume_type = QuobyteHD {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] disk_geometry = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] driver_client_cert = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] driver_client_cert_key = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] driver_data_namespace = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] driver_ssl_cert_path = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] driver_ssl_cert_verify = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] driver_use_ssl = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] enable_new_services = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] enable_unsupported_driver = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] enabled_backends = ['QuobyteHD'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] enforce_multipath_for_image_xfer = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] filter_function = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] glance_api_insecure = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] glance_api_servers = ['http://192.168.122.50/image'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] glance_api_ssl_compression = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] glance_ca_certificates_file = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] glance_catalog_info = image:glance:publicURL {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] glance_certfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] glance_keyfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] glance_num_retries = 3 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] glance_request_timeout = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] goodness_function = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] graceful_shutdown_timeout = 5 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] group_api_class = cinder.group.api.API {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] host = devstack {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] image_compress_on_upload = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] image_conversion_address_space_limit = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] image_conversion_cpu_limit = 60 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] image_conversion_disable = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] image_introspection_address_space_limit = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] image_introspection_cpu_limit = 60 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] image_upload_use_cinder_backend = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] image_upload_use_internal_tenant = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] image_volume_cache_enabled = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] image_volume_cache_max_count = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] image_volume_cache_max_size_gb = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] init_host_max_objects_retrieval = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] instance_format = [instance: %(uuid)s] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] iscsi_target_flags = {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] iscsi_write_cache = on {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] iser_helper = tgtadm {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] iser_ip_address = 192.168.122.50 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] iser_port = 3260 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] log_color = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] log_config_append = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] log_dir = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] log_file = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] log_options = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] log_rotate_interval = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] log_rotate_interval_type = days {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] log_rotation_type = none {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] max_age = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] max_logfile_count = 30 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] max_logfile_size_mb = 200 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] max_over_subscription_ratio = 20.0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] message_reap_interval = 86400 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86498]: INFO cinder.volume.manager [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Starting volume driver QuobyteDriver (1.2.1) Nov 04 18:46:52 devstack cinder-volume[86498]: DEBUG cinder.volume.drivers.remotefs [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86498) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] message_ttl = 2592000 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] migration_create_volume_timeout_secs = 300 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] monkey_patch = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] monkey_patch_modules = [] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] my_ip = 192.168.122.50 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] no_snapshot_gb_quota = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] num_iser_scan_tries = 3 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] num_shell_tries = 3 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] num_volume_device_scan_tries = 3 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] nvmeof_conn_info_version = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] nvmet_ns_id = 10 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] nvmet_port_id = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] osapi_max_limit = 1000 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] osapi_volume_ext_list = [] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] osapi_volume_listen = 0.0.0.0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] osapi_volume_listen_port = 8776 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] osapi_volume_use_ssl = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] osapi_volume_workers = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] per_volume_size_limit = -1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] periodic_fuzzy_delay = 60 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] periodic_interval = 60 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] project_id_regex = [0-9a-f\-]+ {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] public_endpoint = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] publish_errors = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] quota_backup_gigabytes = 1000 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] quota_backups = 10 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] quota_gigabytes = 1000 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] quota_groups = 10 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] quota_snapshots = 10 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] quota_volumes = 10 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] rate_limit_burst = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] rate_limit_except_level = CRITICAL {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] rate_limit_interval = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] reinit_driver_count = 3 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] replication_device = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] report_discard_supported = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] report_interval = 120 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] reservation_clean_interval = 86400 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] reservation_expire = 86400 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] reserved_image_namespaces = [] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] reserved_percentage = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] rpc_response_timeout = 120 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] run_external_periodic_tasks = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] scst_target_driver = iscsi {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] scst_target_iqn_name = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] service_down_time = 720 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] shell_completion = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] snapshot_name_template = snapshot-%s {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] split_loggers = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] state_path = /opt/stack/data/cinder {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] storage_availability_zone = nova {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] storage_protocol = iSCSI {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] syslog_log_facility = LOG_USER {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] target_helper = lioadm {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] target_ip_address = 192.168.122.50 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] target_port = 3260 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] target_protocol = iscsi {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] target_secondary_ip_addresses = [] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] trace_flags = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] transfer_api_class = cinder.transfer.api.API {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] transport_url = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] until_refresh = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] use_chap_auth = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] use_default_quota_class = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] use_journal = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] use_json = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] use_multipath_for_image_xfer = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] use_stderr = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] use_syslog = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] verify_glance_signatures = enabled {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] volume_api_class = cinder.volume.api.API {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] volume_backend_name = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] volume_clear = zero {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] volume_clear_ionice = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] volume_clear_size = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] volume_copy_bps_limit = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] volume_dd_blocksize = 1M {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] volume_name_template = volume-%s {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] volume_service_inithost_offload = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] volume_usage_audit_period = month {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] zoning_mode = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_concurrency.disable_process_locking = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.auth_section = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.auth_type = password {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.auth_version = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.cache = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.certfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.delay_auth_decision = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.http_connect_timeout = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.include_service_catalog = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.insecure = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.interface = public {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.keyfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.memcache_password = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.memcache_username = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.region_name = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.service_token_roles_required = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.service_type = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.token_cache_time = 300 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.50/identity {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.backend = dogpile.cache.null {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86498]: DEBUG cinder.volume.drivers.quobyte [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86498) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 04 18:46:52 devstack cinder-volume[86498]: WARNING cinder.volume.drivers.quobyte [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 04 18:46:52 devstack cinder-volume[86498]: WARNING cinder.volume.drivers.quobyte [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.backend_argument = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.backend_expiration_time = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.config_prefix = cache.oslo {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.debug_cache_backend = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.enable_retry_client = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.enable_socket_keepalive = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86498]: DEBUG oslo_concurrency.processutils [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Running cmd (subprocess): mount.quobyte {{(pid=86498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.enabled = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.expiration_time = 600 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.hashclient_retry_attempts = 2 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.memcache_dead_retry = 300 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.memcache_pool_maxsize = 10 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.memcache_sasl_enabled = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.password = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.proxies = [] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.redis_db = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.redis_sentinel_service_name = mymaster {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.redis_server = localhost:6379 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.retry_attempts = 2 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.retry_delay = 0.0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.socket_keepalive_count = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.socket_keepalive_idle = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.socket_keepalive_interval = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.socket_timeout = 1.0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.tls_allowed_ciphers = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.tls_cafile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.tls_certfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.tls_enabled = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.tls_keyfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cache.username = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] coordination.backend_url = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] database.asyncio_connection = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] database.asyncio_slave_connection = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] database.backend = sqlalchemy {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] database.connection = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] database.connection_debug = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] database.connection_parameters = {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] database.connection_recycle_time = 3600 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] database.connection_trace = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] database.db_inc_retry_interval = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] database.db_max_retries = 20 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] database.db_max_retry_interval = 10 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] database.db_retry_interval = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] database.max_overflow = 50 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] database.max_pool_size = 5 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] database.max_retries = 10 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] database.mysql_wsrep_sync_wait = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] database.pool_timeout = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] database.retry_interval = 10 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] database.slave_connection = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] database.sqlite_synchronous = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] database.synchronous_reader = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] database.use_db_reconnect = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_tracing.insecure = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] profiler.connection_string = messaging:// {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] profiler.enabled = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] profiler.es_doc_type = notification {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] profiler.es_scroll_size = 10000 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] profiler.es_scroll_time = 2m {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] profiler.filter_error_trace = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] profiler.hmac_keys = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] profiler.sentinel_service_name = mymaster {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] profiler.socket_timeout = 0.1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] profiler.trace_requests = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] profiler.trace_sqlalchemy = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] profiler_jaeger.process_tags = {} {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] profiler_jaeger.service_name_prefix = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] profiler_otlp.service_name_prefix = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_policy.enforce_new_defaults = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_policy.policy_default_rule = default {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_policy.policy_file = policy.yaml {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_policy.remote_timeout = 60.0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] privsep_osbrick.group = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] privsep_osbrick.helper_command = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] privsep_osbrick.user = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cinder_sys_admin.group = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cinder_sys_admin.helper_command = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] cinder_sys_admin.user = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] service_user.auth_section = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] service_user.auth_type = password {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] service_user.cafile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] service_user.certfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] service_user.collect_timing = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] service_user.insecure = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] service_user.keyfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] service_user.send_service_user_token = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] service_user.split_loggers = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] service_user.timeout = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] service_user.tls_ciphers = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] service_user.tls_min_version = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] glance.auth_section = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] glance.auth_type = password {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] glance.certfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] glance.collect_timing = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] glance.insecure = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] glance.keyfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] glance.region_name = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] glance.split_loggers = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] glance.timeout = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] glance.tls_ciphers = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] glance.tls_min_version = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.backend_availability_zone = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.chap_password = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.chap_username = {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.disk_geometry = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.driver_client_cert = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.driver_client_cert_key = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.driver_data_namespace = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.driver_use_ssl = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.enable_unsupported_driver = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.extra_capabilities = {} {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.filter_function = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.goodness_function = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.iscsi_target_flags = {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.iscsi_write_cache = on {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.iser_helper = tgtadm {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.iser_ip_address = 192.168.122.50 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.iser_port = 3260 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.nas_host = {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.nas_login = admin {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.nas_mount_options = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.nas_password = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.nas_private_key = {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.nas_share_path = {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.nas_ssh_port = 22 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.num_shell_tries = 3 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.nvmet_port_id = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.quobyte_client_cfg = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.quobyte_volume_url = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.replication_device = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.report_discard_supported = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.reserved_percentage = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.scst_target_driver = iscsi {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.scst_target_iqn_name = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.storage_protocol = iSCSI {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.target_helper = tgtadm {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.target_ip_address = 192.168.122.50 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.target_port = 3260 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.target_protocol = iscsi {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack quobyte-client[86499]: Reading configuration file: /etc/quobyte/client.cfg Nov 04 18:46:52 devstack quobyte-client[86499]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 04 18:46:52 devstack cinder-volume[86498]: DEBUG oslo_concurrency.processutils [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] CMD "mount.quobyte" returned: 1 in 0.125s {{(pid=86498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:46:52 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:46:52 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:46:52 devstack cinder-volume[86498]: DEBUG cinder.volume.drivers.quobyte [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=86498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.trace_flags = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.unique_fqdn_network = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.use_chap_auth = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.volume_backend_name = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.volume_clear = zero {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.volume_clear_ionice = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.volume_clear_size = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86498]: INFO cinder.volume.drivers.quobyte [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 ... Nov 04 18:46:52 devstack cinder-volume[86498]: DEBUG oslo_concurrency.processutils [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 -c /etc/quobyte/client-cinder.cfg {{(pid=86498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_reports.file_event_handler = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_reports.log_dir = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.backend_availability_zone = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.backend_host = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.chap_password = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.chap_username = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.chiscsi_conf = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.disk_geometry = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.driver_client_cert = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.driver_client_cert_key = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.driver_data_namespace = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.driver_use_ssl = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.extra_capabilities = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.filter_function = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.goodness_function = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.iscsi_target_flags = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.iscsi_write_cache = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.iser_helper = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.iser_ip_address = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.iser_port = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.iser_target_prefix = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.nas_host = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.nas_login = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.nas_mount_options = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.nas_password = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.nas_private_key = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.nas_share_path = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.nas_ssh_port = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack sudo[86502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 -c /etc/quobyte/client-cinder.cfg Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.num_shell_tries = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.nvmet_ns_id = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.nvmet_port_id = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack sudo[86502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.replication_device = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.report_discard_supported = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.reserved_percentage = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.scst_target_driver = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.storage_protocol = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.target_helper = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.target_ip_address = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.target_port = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.target_prefix = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.target_protocol = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.trace_flags = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.unique_fqdn_network = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.use_chap_auth = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.volume_clear = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.volume_clear_ionice = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.volume_clear_size = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] QuobyteHD.volumes_dir = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.ssl = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.ssl_version = {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_notifications.driver = [] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_notifications.retry = -1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] oslo_messaging_notifications.transport_url = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] key_manager.fixed_key = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican.barbican_api_version = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican.barbican_endpoint = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican.barbican_endpoint_type = public {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican.barbican_region_name = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican.cafile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican.certfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican.collect_timing = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican.insecure = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican.keyfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican.number_of_retries = 60 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican.retry_delay = 1 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican.send_service_user_token = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican.split_loggers = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican.timeout = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican.tls_ciphers = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican.tls_min_version = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican.verify_ssl = True {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican.verify_ssl_path = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican_service_user.auth_section = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican_service_user.auth_type = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican_service_user.cafile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican_service_user.certfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican_service_user.collect_timing = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican_service_user.insecure = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican_service_user.keyfile = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican_service_user.split_loggers = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican_service_user.timeout = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican_service_user.tls_ciphers = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] barbican_service_user.tls_min_version = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] vault.approle_role_id = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] vault.approle_secret_id = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] vault.auth_method = approle {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] vault.auth_path = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] vault.kv_mountpoint = secret {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] vault.kv_path = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] vault.kv_version = 2 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] vault.namespace = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] vault.root_token_id = **** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] vault.ssl_ca_crt_file = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] vault.timeout = 60.0 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] vault.token_file = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] vault.token_role = None {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] vault.use_ssl = False {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:46:52 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] ******************************************************************************** {{(pid=86280) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 04 18:46:52 devstack sudo[86502]: pam_unix(sudo:session): session closed for user root Nov 04 18:46:52 devstack cinder-volume[86498]: DEBUG oslo_concurrency.processutils [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.412s {{(pid=86498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:46:52 devstack cinder-volume[86498]: INFO cinder.volume.drivers.quobyte [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 succeeded Nov 04 18:46:52 devstack cinder-volume[86498]: DEBUG cinder.volume.drivers.quobyte [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=86498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:46:52 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.434s {{(pid=86498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:46:52 devstack cinder-volume[86498]: DEBUG oslo_concurrency.processutils [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=86498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:46:52 devstack sudo[86606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:46:52 devstack sudo[86606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:46:52 devstack sudo[86606]: pam_unix(sudo:session): session closed for user root Nov 04 18:46:52 devstack cinder-volume[86498]: DEBUG oslo_concurrency.processutils [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.232s {{(pid=86498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:46:52 devstack cinder-volume[86498]: INFO cinder.volume.driver [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Driver hasn't implemented _init_vendor_properties() Nov 04 18:46:52 devstack cinder-volume[86498]: DEBUG cinder.volume.driver [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5831718444824, 'free_capacity_gb': 1773.5831718444824, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86498) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 04 18:46:53 devstack cinder-volume[86498]: DEBUG oslo_db.sqlalchemy.engines [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86498) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:46:53 devstack cinder-volume[86498]: DEBUG dbcounter [-] [86498] Writer thread running {{(pid=86498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 18:46:53 devstack cinder-volume[86498]: DEBUG cinder.db.api [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Building query based on filter {{(pid=86498) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 04 18:46:53 devstack cinder-volume[86498]: DEBUG cinder.image.image_utils [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86498) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 04 18:46:53 devstack cinder-volume[86498]: INFO cinder.keymgr.migration [None req-14e5a8e8-70f3-4dca-a18a-e573078ff3cc None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 04 18:46:53 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:46:53 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:46:53 devstack cinder-volume[86498]: DEBUG cinder.volume.drivers.quobyte [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=86498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:46:53 devstack cinder-volume[86498]: DEBUG cinder.volume.drivers.quobyte [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=86498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:46:53 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:46:53 devstack cinder-volume[86498]: DEBUG oslo_concurrency.processutils [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=86498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:46:53 devstack sudo[86609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:46:53 devstack sudo[86609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:46:53 devstack sudo[86609]: pam_unix(sudo:session): session closed for user root Nov 04 18:46:53 devstack cinder-volume[86498]: DEBUG oslo_concurrency.processutils [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.220s {{(pid=86498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:46:53 devstack cinder-volume[86498]: DEBUG cinder.manager [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Notifying Schedulers of capabilities ... {{(pid=86498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:46:53 devstack cinder-volume[86498]: INFO cinder.volume.manager [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Driver initialization completed successfully. Nov 04 18:46:53 devstack cinder-volume[86498]: INFO cinder.manager [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Initiating service 3 cleanup Nov 04 18:46:53 devstack cinder-volume[86498]: INFO cinder.manager [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Service 3 cleanup completed. Nov 04 18:46:53 devstack cinder-volume[86498]: DEBUG cinder.service [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Creating RPC server for service cinder-volume {{(pid=86498) start /opt/stack/cinder/cinder/service.py:231}} Nov 04 18:46:53 devstack cinder-volume[86498]: DEBUG cinder.service [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86498) start /opt/stack/cinder/cinder/service.py:237}} Nov 04 18:46:53 devstack cinder-volume[86498]: INFO cinder.volume.manager [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 04 18:46:53 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:46:53 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:46:53 devstack cinder-volume[86498]: DEBUG cinder.volume.drivers.quobyte [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=86498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:46:53 devstack cinder-volume[86498]: DEBUG cinder.volume.drivers.quobyte [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=86498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:46:53 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:46:53 devstack cinder-volume[86498]: DEBUG oslo_concurrency.processutils [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=86498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:46:53 devstack sudo[86612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:46:53 devstack sudo[86612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:46:53 devstack sudo[86612]: pam_unix(sudo:session): session closed for user root Nov 04 18:46:53 devstack cinder-volume[86498]: DEBUG oslo_concurrency.processutils [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.255s {{(pid=86498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:46:53 devstack cinder-volume[86498]: INFO cinder.volume.manager [None req-4cf48113-cc66-415a-a3f7-9ab3ba90f00c None None] Driver post RPC initialization completed successfully. Nov 04 18:46:56 devstack cinder-volume[86498]: DEBUG oslo_service.periodic_task [None req-7fe6219e-3eb5-42c5-bf82-a6ac8ead1d4f None None] Running periodic task VolumeManager._thread_info {{(pid=86498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:46:56 devstack cinder-volume[86498]: DEBUG cinder.volume.manager [None req-7fe6219e-3eb5-42c5-bf82-a6ac8ead1d4f None None] thread count: 6 {{(pid=86498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:46:56 devstack cinder-volume[86498]: DEBUG cinder.volume.manager [None req-7fe6219e-3eb5-42c5-bf82-a6ac8ead1d4f None None] thread info: [<_MainThread(MainThread, started 140428541431936)>, , , , , ] {{(pid=86498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:46:58 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-5ecb9d80-2f12-46e6-a3a7-05a515445cac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:46:58 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-5ecb9d80-2f12-46e6-a3a7-05a515445cac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:46:58 devstack cinder-volume[86498]: DEBUG cinder.volume.drivers.quobyte [None req-5ecb9d80-2f12-46e6-a3a7-05a515445cac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=86498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:46:58 devstack cinder-volume[86498]: DEBUG cinder.volume.drivers.quobyte [None req-5ecb9d80-2f12-46e6-a3a7-05a515445cac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=86498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:46:58 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-5ecb9d80-2f12-46e6-a3a7-05a515445cac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:46:58 devstack cinder-volume[86498]: DEBUG oslo_concurrency.processutils [None req-5ecb9d80-2f12-46e6-a3a7-05a515445cac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=86498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:46:58 devstack sudo[86745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:46:58 devstack sudo[86745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:46:58 devstack sudo[86745]: pam_unix(sudo:session): session closed for user root Nov 04 18:46:58 devstack cinder-volume[86498]: DEBUG oslo_concurrency.processutils [None req-5ecb9d80-2f12-46e6-a3a7-05a515445cac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.247s {{(pid=86498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:46:58 devstack cinder-volume[86498]: DEBUG cinder.manager [None req-5ecb9d80-2f12-46e6-a3a7-05a515445cac None None] Notifying Schedulers of capabilities ... {{(pid=86498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:46:58 devstack cinder-volume[86280]: INFO oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] Caught SIGTERM, stopping children Nov 04 18:46:58 devstack cinder-volume[86280]: DEBUG oslo_concurrency.lockutils [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] Acquiring lock "singleton_lock" {{(pid=86280) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 18:46:58 devstack cinder-volume[86280]: DEBUG oslo_concurrency.lockutils [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] Acquired lock "singleton_lock" {{(pid=86280) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 18:46:58 devstack cinder-volume[86280]: DEBUG oslo_concurrency.lockutils [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] Releasing lock "singleton_lock" {{(pid=86280) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 18:46:58 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] Stop services. {{(pid=86280) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 04 18:46:58 devstack cinder-volume[86280]: DEBUG oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] Killing children. {{(pid=86280) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 04 18:46:58 devstack cinder-volume[86280]: INFO oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] Waiting on 1 children to exit Nov 04 18:47:01 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] Acquiring lock "singleton_lock" {{(pid=86498) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 18:47:01 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] Acquired lock "singleton_lock" {{(pid=86498) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 18:47:01 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] Releasing lock "singleton_lock" {{(pid=86498) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 18:47:01 devstack cinder-volume[86498]: WARNING amqp [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 04 18:47:01 devstack cinder-volume[86498]: WARNING amqp [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 04 18:47:01 devstack cinder-volume[86280]: INFO oslo_service.backend._eventlet.service [None req-e2119f0b-2699-4e2e-8d09-f8e1745f40bb None None] Child 86498 exited with status 0 Nov 04 18:47:02 devstack cinder-volume[86816]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 04 18:47:02 devstack cinder-volume[86816]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 04 18:47:02 devstack cinder-volume[86816]: we strongly recommend against using it for new projects. Nov 04 18:47:02 devstack cinder-volume[86816]: If you are already using Eventlet, we recommend migrating to a different Nov 04 18:47:02 devstack cinder-volume[86816]: framework. For more detail see Nov 04 18:47:02 devstack cinder-volume[86816]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 04 18:47:02 devstack cinder-volume[86816]: import eventlet # noqa Nov 04 18:47:05 devstack cinder-volume[86816]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86816) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 18:47:05 devstack cinder-volume[86816]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86816) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 18:47:05 devstack cinder-volume[86816]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86816) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 18:47:06 devstack cinder-volume[86816]: INFO dbcounter [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] Registered counter for database cinder Nov 04 18:47:06 devstack cinder-volume[86816]: DEBUG oslo_db.sqlalchemy.engines [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86816) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:47:06 devstack cinder-volume[86816]: DEBUG dbcounter [-] [86816] Writer thread running {{(pid=86816) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 18:47:06 devstack cinder-volume[86816]: INFO cinder.rpc [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 04 18:47:06 devstack cinder-volume[86816]: INFO cinder.rpc [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 04 18:47:06 devstack cinder-volume[86816]: DEBUG oslo_db.sqlalchemy.engines [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86816) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:47:06 devstack cinder-volume[86816]: INFO cinder.volume.manager [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] Determined volume DB was empty at startup. Nov 04 18:47:06 devstack cinder-volume[86816]: DEBUG cinder.volume.manager [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86816) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 04 18:47:06 devstack cinder-volume[86816]: WARNING stevedore.named [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 04 18:47:06 devstack cinder-volume[86816]: WARNING castellan.key_manager [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 18:47:06 devstack cinder-volume[86816]: WARNING cinder.keymgr.conf_key_mgr [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 18:47:06 devstack cinder-volume[86816]: INFO cinder.volume.manager [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_db.sqlalchemy.engines [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86816) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:47:07 devstack cinder-volume[86816]: INFO oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] Starting 1 workers Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] Started child 87119 {{(pid=86816) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] Full set of CONF: {{(pid=86816) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] ******************************************************************************** {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] Configuration options gathered from: {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] ================================================================================ {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] allow_availability_zone_fallback = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] allow_compression_on_image_upload = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] allowed_direct_url_schemes = [] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] api_rate_limit = True {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] auth_strategy = keystone {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_availability_zone = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_host = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_name = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_stats_polling_interval = 60 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backup_api_class = cinder.backup.api.API {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backup_name_template = backup-%s {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backup_use_same_host = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backup_use_temp_snapshot = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] chap_password = **** {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] chap_username = {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[87119]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cinder_internal_tenant_project_id = 9b968ffa3f70408ab1facb5b26e6440f {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cinder_internal_tenant_user_id = acee065e482646f69038dc7efd277797 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cluster = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] compression_format = gzip {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] compute_api_class = cinder.compute.nova.API {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] config_dir = [] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] config_source = [] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] control_exchange = openstack {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] debug = True {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] default_availability_zone = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] default_group_type = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] default_volume_type = QuobyteHD {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] disk_geometry = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] driver_client_cert = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] driver_client_cert_key = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] driver_data_namespace = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] driver_ssl_cert_path = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] driver_ssl_cert_verify = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] driver_use_ssl = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] enable_new_services = True {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] enable_unsupported_driver = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] enabled_backends = ['QuobyteHD'] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] enforce_multipath_for_image_xfer = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] filter_function = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] glance_api_insecure = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] glance_api_servers = ['http://192.168.122.50/image'] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] glance_api_ssl_compression = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] glance_ca_certificates_file = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] glance_catalog_info = image:glance:publicURL {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] glance_certfile = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] glance_keyfile = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] glance_num_retries = 3 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] glance_request_timeout = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] goodness_function = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] graceful_shutdown_timeout = 5 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] group_api_class = cinder.group.api.API {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] host = devstack {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] image_compress_on_upload = True {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] image_conversion_address_space_limit = 1 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] image_conversion_cpu_limit = 60 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] image_conversion_disable = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] image_introspection_address_space_limit = 1 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] image_introspection_cpu_limit = 60 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] image_upload_use_cinder_backend = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] image_upload_use_internal_tenant = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] image_volume_cache_enabled = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] image_volume_cache_max_count = 0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] image_volume_cache_max_size_gb = 0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] init_host_max_objects_retrieval = 0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] instance_format = [instance: %(uuid)s] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] iscsi_target_flags = {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] iscsi_write_cache = on {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] iser_helper = tgtadm {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] iser_ip_address = 192.168.122.50 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] iser_port = 3260 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] log_color = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] log_config_append = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] log_dir = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] log_file = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] log_options = True {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] log_rotate_interval = 1 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] log_rotate_interval_type = days {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] log_rotation_type = none {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] max_age = 0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] max_logfile_count = 30 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] max_logfile_size_mb = 200 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] max_over_subscription_ratio = 20.0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] message_reap_interval = 86400 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] message_ttl = 2592000 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] migration_create_volume_timeout_secs = 300 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] monkey_patch = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] monkey_patch_modules = [] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] my_ip = 192.168.122.50 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] no_snapshot_gb_quota = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] num_iser_scan_tries = 3 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Starting volume driver QuobyteDriver (1.2.1) Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87119) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] num_shell_tries = 3 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] num_volume_device_scan_tries = 3 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] nvmeof_conn_info_version = 1 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] nvmet_ns_id = 10 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] nvmet_port_id = 1 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] osapi_max_limit = 1000 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] osapi_volume_ext_list = [] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] osapi_volume_listen = 0.0.0.0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] osapi_volume_listen_port = 8776 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] osapi_volume_use_ssl = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] osapi_volume_workers = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] per_volume_size_limit = -1 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] periodic_fuzzy_delay = 60 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] periodic_interval = 60 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] project_id_regex = [0-9a-f\-]+ {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] public_endpoint = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] publish_errors = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] quota_backup_gigabytes = 1000 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] quota_backups = 10 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] quota_gigabytes = 1000 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] quota_groups = 10 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] quota_snapshots = 10 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] quota_volumes = 10 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] rate_limit_burst = 0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] rate_limit_except_level = CRITICAL {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] rate_limit_interval = 0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] reinit_driver_count = 3 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] replication_device = **** {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] report_discard_supported = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] report_interval = 120 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] reservation_clean_interval = 86400 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] reservation_expire = 86400 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] reserved_image_namespaces = [] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] reserved_percentage = 0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] rpc_response_timeout = 120 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] run_external_periodic_tasks = True {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] scst_target_driver = iscsi {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] scst_target_iqn_name = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] service_down_time = 720 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] shell_completion = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] snapshot_name_template = snapshot-%s {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] split_loggers = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] state_path = /opt/stack/data/cinder {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] storage_availability_zone = nova {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] storage_protocol = iSCSI {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] syslog_log_facility = LOG_USER {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] target_helper = lioadm {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] target_ip_address = 192.168.122.50 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] target_port = 3260 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] target_protocol = iscsi {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] target_secondary_ip_addresses = [] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] trace_flags = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] transfer_api_class = cinder.transfer.api.API {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] transport_url = **** {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] until_refresh = 0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] use_chap_auth = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] use_default_quota_class = True {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] use_journal = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] use_json = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] use_multipath_for_image_xfer = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] use_stderr = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] use_syslog = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] verify_glance_signatures = enabled {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] volume_api_class = cinder.volume.api.API {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] volume_backend_name = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] volume_clear = zero {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] volume_clear_ionice = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] volume_clear_size = 0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] volume_copy_bps_limit = 0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] volume_dd_blocksize = 1M {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] volume_name_template = volume-%s {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] volume_service_inithost_offload = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] volume_usage_audit_period = month {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] zoning_mode = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_concurrency.disable_process_locking = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.auth_section = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.auth_type = password {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.auth_version = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.cache = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.certfile = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.delay_auth_decision = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.http_connect_timeout = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.include_service_catalog = True {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.insecure = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.interface = public {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.keyfile = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.memcache_password = **** {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.memcache_username = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.region_name = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87119) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.quobyte [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 04 18:47:07 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.quobyte [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.service_token_roles_required = True {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.service_type = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.token_cache_time = 300 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.50/identity {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.backend = dogpile.cache.null {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.backend_argument = **** {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Running cmd (subprocess): mount.quobyte {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.backend_expiration_time = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.config_prefix = cache.oslo {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.debug_cache_backend = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.enable_retry_client = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.enable_socket_keepalive = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.enabled = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.expiration_time = 600 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.hashclient_retry_attempts = 2 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.memcache_dead_retry = 300 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.memcache_pool_maxsize = 10 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.memcache_sasl_enabled = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.password = **** {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.proxies = [] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.redis_db = 0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.redis_sentinel_service_name = mymaster {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.redis_server = localhost:6379 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.retry_attempts = 2 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.retry_delay = 0.0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.socket_keepalive_count = 1 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.socket_keepalive_idle = 1 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.socket_keepalive_interval = 1 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.socket_timeout = 1.0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.tls_allowed_ciphers = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.tls_cafile = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.tls_certfile = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.tls_enabled = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.tls_keyfile = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cache.username = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] coordination.backend_url = **** {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] database.asyncio_connection = **** {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] database.asyncio_slave_connection = **** {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] database.backend = sqlalchemy {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] database.connection = **** {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] database.connection_debug = 0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] database.connection_parameters = {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] database.connection_recycle_time = 3600 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] database.connection_trace = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] database.db_inc_retry_interval = True {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] database.db_max_retries = 20 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] database.db_max_retry_interval = 10 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] database.db_retry_interval = 1 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] database.max_overflow = 50 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] database.max_pool_size = 5 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] database.max_retries = 10 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] database.mysql_wsrep_sync_wait = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] database.pool_timeout = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] database.retry_interval = 10 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] database.slave_connection = **** {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] database.sqlite_synchronous = True {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] database.synchronous_reader = True {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] database.use_db_reconnect = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_tracing.insecure = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] profiler.connection_string = messaging:// {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] profiler.enabled = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] profiler.es_doc_type = notification {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] profiler.es_scroll_size = 10000 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] profiler.es_scroll_time = 2m {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] profiler.filter_error_trace = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] profiler.hmac_keys = **** {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] profiler.sentinel_service_name = mymaster {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] profiler.socket_timeout = 0.1 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] profiler.trace_requests = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] profiler.trace_sqlalchemy = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] profiler_jaeger.process_tags = {} {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] profiler_jaeger.service_name_prefix = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] profiler_otlp.service_name_prefix = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_policy.enforce_new_defaults = True {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_policy.policy_default_rule = default {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_policy.policy_file = policy.yaml {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_policy.remote_timeout = 60.0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] privsep_osbrick.group = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] privsep_osbrick.helper_command = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] privsep_osbrick.user = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cinder_sys_admin.group = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cinder_sys_admin.helper_command = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] cinder_sys_admin.user = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] service_user.auth_section = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] service_user.auth_type = password {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] service_user.cafile = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] service_user.certfile = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] service_user.collect_timing = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] service_user.insecure = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] service_user.keyfile = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] service_user.send_service_user_token = True {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] service_user.split_loggers = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] service_user.timeout = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] service_user.tls_ciphers = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] service_user.tls_min_version = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] glance.auth_section = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] glance.auth_type = password {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] glance.certfile = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] glance.collect_timing = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] glance.insecure = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] glance.keyfile = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] glance.region_name = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] glance.split_loggers = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] glance.timeout = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] glance.tls_ciphers = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] glance.tls_min_version = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.backend_availability_zone = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.chap_password = **** {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.chap_username = {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack quobyte-client[87120]: Reading configuration file: /etc/quobyte/client.cfg Nov 04 18:47:07 devstack quobyte-client[87120]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.disk_geometry = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.driver_client_cert = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.driver_client_cert_key = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.driver_data_namespace = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.driver_use_ssl = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.enable_unsupported_driver = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] CMD "mount.quobyte" returned: 1 in 0.062s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.extra_capabilities = {} {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.filter_function = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.goodness_function = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.iscsi_target_flags = {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.iscsi_write_cache = on {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.iser_helper = tgtadm {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.iser_ip_address = 192.168.122.50 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.iser_port = 3260 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.nas_host = {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.nas_login = admin {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.nas_mount_options = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.nas_password = **** {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.nas_private_key = {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.nas_share_path = {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.nas_ssh_port = 22 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.num_shell_tries = 3 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.nvmet_port_id = 1 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.quobyte_client_cfg = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.quobyte_volume_url = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.replication_device = **** {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.report_discard_supported = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.reserved_percentage = 0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.scst_target_driver = iscsi {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.scst_target_iqn_name = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.storage_protocol = iSCSI {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.target_helper = tgtadm {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.target_ip_address = 192.168.122.50 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.target_port = 3260 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.target_protocol = iscsi {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.trace_flags = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.unique_fqdn_network = True {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.use_chap_auth = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.volume_backend_name = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.volume_clear = zero {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.volume_clear_ionice = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.volume_clear_size = 0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_reports.file_event_handler = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_reports.log_dir = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.backend_availability_zone = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.backend_host = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.chap_password = **** {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack sudo[87121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.chap_username = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.chiscsi_conf = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.disk_geometry = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack sudo[87121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.driver_client_cert = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.driver_client_cert_key = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.driver_data_namespace = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.driver_use_ssl = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.extra_capabilities = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.filter_function = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.goodness_function = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.iscsi_target_flags = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.iscsi_write_cache = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.iser_helper = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.iser_ip_address = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.iser_port = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.iser_target_prefix = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.nas_host = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.nas_login = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.nas_mount_options = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.nas_password = **** {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.nas_private_key = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.nas_share_path = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.nas_ssh_port = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.num_shell_tries = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.nvmet_ns_id = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.nvmet_port_id = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.replication_device = **** {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.report_discard_supported = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.reserved_percentage = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.scst_target_driver = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.storage_protocol = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.target_helper = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.target_ip_address = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.target_port = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.target_prefix = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.target_protocol = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.trace_flags = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.unique_fqdn_network = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.use_chap_auth = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.volume_clear = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.volume_clear_ionice = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.volume_clear_size = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] QuobyteHD.volumes_dir = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.ssl = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.ssl_version = {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_notifications.driver = [] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_notifications.retry = -1 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] oslo_messaging_notifications.transport_url = **** {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] key_manager.fixed_key = **** {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican.barbican_api_version = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican.barbican_endpoint = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican.barbican_endpoint_type = public {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican.barbican_region_name = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican.cafile = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican.certfile = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican.collect_timing = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican.insecure = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican.keyfile = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican.number_of_retries = 60 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican.retry_delay = 1 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican.send_service_user_token = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican.split_loggers = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican.timeout = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican.tls_ciphers = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican.tls_min_version = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican.verify_ssl = True {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican.verify_ssl_path = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican_service_user.auth_section = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican_service_user.auth_type = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican_service_user.cafile = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican_service_user.certfile = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican_service_user.collect_timing = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican_service_user.insecure = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican_service_user.keyfile = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican_service_user.split_loggers = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican_service_user.timeout = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican_service_user.tls_ciphers = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] barbican_service_user.tls_min_version = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] vault.approle_role_id = **** {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] vault.approle_secret_id = **** {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] vault.auth_method = approle {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] vault.auth_path = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] vault.kv_mountpoint = secret {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] vault.kv_path = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] vault.kv_version = 2 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] vault.namespace = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] vault.root_token_id = **** {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] vault.ssl_ca_crt_file = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] vault.timeout = 60.0 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] vault.token_file = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] vault.token_role = None {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] vault.use_ssl = False {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:47:07 devstack cinder-volume[86816]: DEBUG oslo_service.backend._eventlet.service [None req-e0bb5612-d8de-43d2-91a1-d9f4eff54d4b None None] ******************************************************************************** {{(pid=86816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 04 18:47:07 devstack sudo[87121]: pam_unix(sudo:session): session closed for user root Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.245s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:47:07 devstack cinder-volume[87119]: INFO cinder.volume.driver [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Driver hasn't implemented _init_vendor_properties() Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG cinder.volume.driver [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5831718444824, 'free_capacity_gb': 1773.5831718444824, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87119) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG oslo_db.sqlalchemy.engines [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87119) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writer thread running {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG cinder.db.api [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Building query based on filter {{(pid=87119) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87119) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:47:07 devstack cinder-volume[87119]: INFO cinder.keymgr.migration [None req-b5510a2c-c33f-4669-8444-fe8def134f09 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 04 18:47:07 devstack sudo[87132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:47:07 devstack sudo[87132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:47:07 devstack sudo[87132]: pam_unix(sudo:session): session closed for user root Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.238s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:47:07 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Driver initialization completed successfully. Nov 04 18:47:07 devstack cinder-volume[87119]: INFO cinder.manager [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Initiating service 3 cleanup Nov 04 18:47:07 devstack cinder-volume[87119]: INFO cinder.manager [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Service 3 cleanup completed. Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG cinder.service [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Creating RPC server for service cinder-volume {{(pid=87119) start /opt/stack/cinder/cinder/service.py:231}} Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG cinder.service [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87119) start /opt/stack/cinder/cinder/service.py:237}} Nov 04 18:47:07 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:47:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:47:07 devstack sudo[87145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:47:07 devstack sudo[87145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:47:08 devstack sudo[87145]: pam_unix(sudo:session): session closed for user root Nov 04 18:47:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.249s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:47:08 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-9c81e9c3-b67b-4d5a-b790-d87c42dd341f None None] Driver post RPC initialization completed successfully. Nov 04 18:47:17 devstack cinder-volume[86816]: DEBUG dbcounter [-] [86816] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86816) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:47:17 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:47:18 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=4 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:47:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager._thread_info {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:47:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread count: 6 {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:47:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread info: [<_MainThread(MainThread, started 130247852032128)>, , , , , ] {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:48:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:48:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:48:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:48:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:48:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:48:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:48:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:48:25 devstack sudo[87907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:48:25 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:48:25 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root Nov 04 18:48:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.705s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:48:25 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:48:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager._thread_info {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:48:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread count: 6 {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:48:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread info: [<_MainThread(MainThread, started 130247852032128)>, , , , , ] {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:48:28 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:48:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Flow 'volume_create_manager' (543c34d8-dbb0-41a5-a04a-f6ee2d89b4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:48:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (856e9c95-f8b8-4b86-883b-bceb89953137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:48:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (856e9c95-f8b8-4b86-883b-bceb89953137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-350062810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c230813a-864a-44fa-830b-09d9bfd80943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb33b63f93d24faab3310bc7fc6af91e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:48:28Z,use_quota=True,user_id='50ab6c28a72449feab72e5c3a920df88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:48:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f27d850-3149-4007-832b-dbf63adb0aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:48:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f27d850-3149-4007-832b-dbf63adb0aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:48:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (907f02c9-cb37-45bd-90ce-74226abb4c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:48:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (907f02c9-cb37-45bd-90ce-74226abb4c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c230813a-864a-44fa-830b-09d9bfd80943', 'volume_name': 'volume-c230813a-864a-44fa-830b-09d9bfd80943', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:48:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fb42a0f-abf3-458c-a870-636f66e8bed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:48:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fb42a0f-abf3-458c-a870-636f66e8bed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:48:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20cec700-665d-4f0a-9cd2-5269a3e755d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:48:28 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Volume c230813a-864a-44fa-830b-09d9bfd80943: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c230813a-864a-44fa-830b-09d9bfd80943', 'volume_size': 1} Nov 04 18:48:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:48:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:48:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-350062810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c230813a-864a-44fa-830b-09d9bfd80943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb33b63f93d24faab3310bc7fc6af91e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:48:28Z,use_quota=True,user_id='50ab6c28a72449feab72e5c3a920df88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:48:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Creating volume c230813a-864a-44fa-830b-09d9bfd80943 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:48:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:48:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:48:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:48:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:48:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:48:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:48:28 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:48:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c230813a-864a-44fa-830b-09d9bfd80943 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:48:28 devstack sudo[87915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c230813a-864a-44fa-830b-09d9bfd80943 1073741824 Nov 04 18:48:28 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:48:29 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root Nov 04 18:48:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c230813a-864a-44fa-830b-09d9bfd80943 1073741824" returned: 0 in 0.992s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:48:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c230813a-864a-44fa-830b-09d9bfd80943 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:48:29 devstack sudo[88234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c230813a-864a-44fa-830b-09d9bfd80943 Nov 04 18:48:29 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:48:30 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root Nov 04 18:48:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c230813a-864a-44fa-830b-09d9bfd80943" returned: 0 in 0.549s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:48:30 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:48:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:48:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20cec700-665d-4f0a-9cd2-5269a3e755d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c230813a-864a-44fa-830b-09d9bfd80943', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:48:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a494c35-da99-40f4-8d7e-d7ea82693c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:48:30 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Volume volume-c230813a-864a-44fa-830b-09d9bfd80943 (c230813a-864a-44fa-830b-09d9bfd80943): created successfully Nov 04 18:48:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a494c35-da99-40f4-8d7e-d7ea82693c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:48:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Flow 'volume_create_manager' (543c34d8-dbb0-41a5-a04a-f6ee2d89b4bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:48:30 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-a0d35524-4185-4d57-a5b3-584f2139f10c tempest-VolumesAdminNegativeTest-1669735724 None] Created volume successfully. Nov 04 18:48:31 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f7acedae-17c1-43de-b2c5-87025ff6653f tempest-VolumesAdminNegativeTest-1669735724 None] Acquiring lock "cinder-c230813a-864a-44fa-830b-09d9bfd80943-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:48:31 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f7acedae-17c1-43de-b2c5-87025ff6653f tempest-VolumesAdminNegativeTest-1669735724 None] Lock "cinder-c230813a-864a-44fa-830b-09d9bfd80943-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:48:31 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f7acedae-17c1-43de-b2c5-87025ff6653f tempest-VolumesAdminNegativeTest-1669735724 None] Acquiring lock "cinder-quobyte-c230813a-864a-44fa-830b-09d9bfd80943" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:48:31 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f7acedae-17c1-43de-b2c5-87025ff6653f tempest-VolumesAdminNegativeTest-1669735724 None] Lock "cinder-quobyte-c230813a-864a-44fa-830b-09d9bfd80943" acquired by "delete_volume" :: waited 0.038s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:48:31 devstack cinder-volume[87119]: INFO oslo.privsep.daemon [None req-f7acedae-17c1-43de-b2c5-87025ff6653f tempest-VolumesAdminNegativeTest-1669735724 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpkobrfumx/privsep.sock'] Nov 04 18:48:31 devstack sudo[88239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpkobrfumx/privsep.sock Nov 04 18:48:31 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:48:33 devstack cinder-volume[87119]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 04 18:48:33 devstack cinder-volume[87119]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 04 18:48:33 devstack cinder-volume[87119]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 04 18:48:33 devstack cinder-volume[87119]: WARNING oslo.privsep.daemon [-] privsep log: Nov 04 18:48:33 devstack cinder-volume[87119]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 04 18:48:33 devstack cinder-volume[87119]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 04 18:48:33 devstack cinder-volume[87119]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 04 18:48:33 devstack cinder-volume[87119]: WARNING oslo.privsep.daemon [-] privsep log: Nov 04 18:48:33 devstack cinder-volume[87119]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 04 18:48:33 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root Nov 04 18:48:33 devstack cinder-volume[87119]: INFO oslo.privsep.daemon [None req-f7acedae-17c1-43de-b2c5-87025ff6653f tempest-VolumesAdminNegativeTest-1669735724 None] Spawned new privsep daemon via rootwrap Nov 04 18:48:33 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [None req-f7acedae-17c1-43de-b2c5-87025ff6653f tempest-VolumesAdminNegativeTest-1669735724 None] Accepted privsep connection to /tmp/tmpkobrfumx/privsep.sock {{(pid=87119) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 04 18:48:33 devstack cinder-volume[87119]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 04 18:48:33 devstack cinder-volume[87119]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 04 18:48:33 devstack cinder-volume[87119]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 04 18:48:33 devstack cinder-volume[87119]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88242 Nov 04 18:48:33 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0973b2-00cd-42a6-8a26-888a7b93c0c5]: (2,) {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:48:33 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6304a8-e08f-496b-a51c-d103162989a9]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:48:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f7acedae-17c1-43de-b2c5-87025ff6653f tempest-VolumesAdminNegativeTest-1669735724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c230813a-864a-44fa-830b-09d9bfd80943 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:48:33 devstack sudo[88244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c230813a-864a-44fa-830b-09d9bfd80943 Nov 04 18:48:33 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:48:34 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root Nov 04 18:48:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f7acedae-17c1-43de-b2c5-87025ff6653f tempest-VolumesAdminNegativeTest-1669735724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c230813a-864a-44fa-830b-09d9bfd80943" returned: 0 in 0.870s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:48:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f7acedae-17c1-43de-b2c5-87025ff6653f tempest-VolumesAdminNegativeTest-1669735724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c230813a-864a-44fa-830b-09d9bfd80943 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:48:34 devstack sudo[88255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c230813a-864a-44fa-830b-09d9bfd80943 Nov 04 18:48:34 devstack sudo[88255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:48:34 devstack sudo[88255]: pam_unix(sudo:session): session closed for user root Nov 04 18:48:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f7acedae-17c1-43de-b2c5-87025ff6653f tempest-VolumesAdminNegativeTest-1669735724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c230813a-864a-44fa-830b-09d9bfd80943" returned: 0 in 0.366s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:48:34 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f7acedae-17c1-43de-b2c5-87025ff6653f tempest-VolumesAdminNegativeTest-1669735724 None] Lock "cinder-quobyte-c230813a-864a-44fa-830b-09d9bfd80943" released by "delete_volume" :: held 2.963s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:48:34 devstack cinder-volume[87119]: WARNING cinder.quota [None req-f7acedae-17c1-43de-b2c5-87025ff6653f tempest-VolumesAdminNegativeTest-1669735724 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:48:34 devstack cinder-volume[87119]: WARNING cinder.quota [None req-f7acedae-17c1-43de-b2c5-87025ff6653f tempest-VolumesAdminNegativeTest-1669735724 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:48:34 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-f7acedae-17c1-43de-b2c5-87025ff6653f tempest-VolumesAdminNegativeTest-1669735724 None] Created reservations ['952b7811-51d4-48e2-ba73-46e10d9beae7', '2d326727-977c-41ae-b515-6a55c2869b37', '209d705e-16a9-434b-9186-c214942d5c61', 'c8a6ebff-03ee-43a3-baa6-c9c3981a6c7e'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:48:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f7acedae-17c1-43de-b2c5-87025ff6653f tempest-VolumesAdminNegativeTest-1669735724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:48:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f7acedae-17c1-43de-b2c5-87025ff6653f tempest-VolumesAdminNegativeTest-1669735724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:48:35 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f7acedae-17c1-43de-b2c5-87025ff6653f tempest-VolumesAdminNegativeTest-1669735724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:48:35 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f7acedae-17c1-43de-b2c5-87025ff6653f tempest-VolumesAdminNegativeTest-1669735724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:48:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f7acedae-17c1-43de-b2c5-87025ff6653f tempest-VolumesAdminNegativeTest-1669735724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:48:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f7acedae-17c1-43de-b2c5-87025ff6653f tempest-VolumesAdminNegativeTest-1669735724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:48:35 devstack sudo[88271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:48:35 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:48:35 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root Nov 04 18:48:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f7acedae-17c1-43de-b2c5-87025ff6653f tempest-VolumesAdminNegativeTest-1669735724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.523s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:48:35 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-f7acedae-17c1-43de-b2c5-87025ff6653f tempest-VolumesAdminNegativeTest-1669735724 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:48:35 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-f7acedae-17c1-43de-b2c5-87025ff6653f tempest-VolumesAdminNegativeTest-1669735724 None] Deleted volume successfully. Nov 04 18:48:35 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f7acedae-17c1-43de-b2c5-87025ff6653f tempest-VolumesAdminNegativeTest-1669735724 None] Lock "cinder-c230813a-864a-44fa-830b-09d9bfd80943-delete_volume" released by "delete_volume" :: held 4.085s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:48:45 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=7,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:48:45 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:UPDATE=10,cinder:SELECT=7,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:48:46 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:48:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Flow 'volume_create_manager' (55465219-97b4-4e32-9b72-b5445e0aea2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b41b294-92e8-4461-a133-b2bd8c1170ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b41b294-92e8-4461-a133-b2bd8c1170ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1865365697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc75833f-19af-4f9f-8b27-0d7c314732e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4801e0ce4d47da98d5b5c2710d50a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:48:47Z,use_quota=True,user_id='9781f272e19b4fcda6fd614b14fa079e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a07b5e-e059-400a-b270-40eb282757ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a07b5e-e059-400a-b270-40eb282757ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fcebaf1-413b-456c-9ae3-5a3663c3c2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fcebaf1-413b-456c-9ae3-5a3663c3c2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc75833f-19af-4f9f-8b27-0d7c314732e2', 'volume_name': 'volume-dc75833f-19af-4f9f-8b27-0d7c314732e2', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5692db8c-a01e-4c5e-b997-6ab559a0b9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5692db8c-a01e-4c5e-b997-6ab559a0b9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd567e0a-999c-4c6a-81c8-98be3886b19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:48:47 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Volume dc75833f-19af-4f9f-8b27-0d7c314732e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc75833f-19af-4f9f-8b27-0d7c314732e2', 'volume_size': 1} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1865365697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc75833f-19af-4f9f-8b27-0d7c314732e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4801e0ce4d47da98d5b5c2710d50a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:48:47Z,use_quota=True,user_id='9781f272e19b4fcda6fd614b14fa079e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Creating volume dc75833f-19af-4f9f-8b27-0d7c314732e2 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:48:47 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dc75833f-19af-4f9f-8b27-0d7c314732e2 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:48:47 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dc75833f-19af-4f9f-8b27-0d7c314732e2 1073741824 Nov 04 18:48:47 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Flow 'volume_create_manager' (ab20d87e-27ec-4b20-a3cf-bc7d577c7b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d5eb8d-4314-439a-b7ed-a79369ef2bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:48:47 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d5eb8d-4314-439a-b7ed-a79369ef2bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1642436021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c427bb4-e300-4402-ba79-05346930e493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af69da288d19442a94446e0ad4dd3a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:48:48Z,use_quota=True,user_id='11d00b23857f4823aee04603f362120f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04fbe514-f53a-4c07-9a81-3f45b0c7e7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04fbe514-f53a-4c07-9a81-3f45b0c7e7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae519517-2aeb-4a9e-89e6-297167007599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae519517-2aeb-4a9e-89e6-297167007599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c427bb4-e300-4402-ba79-05346930e493', 'volume_name': 'volume-6c427bb4-e300-4402-ba79-05346930e493', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfaa5c80-bcb2-48f4-89ce-d167672f57ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfaa5c80-bcb2-48f4-89ce-d167672f57ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e7499bb-8612-40af-87e4-d9f64d11de13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:48:47 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Volume 6c427bb4-e300-4402-ba79-05346930e493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c427bb4-e300-4402-ba79-05346930e493', 'volume_size': 1} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dc75833f-19af-4f9f-8b27-0d7c314732e2 1073741824" returned: 0 in 0.693s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:48:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dc75833f-19af-4f9f-8b27-0d7c314732e2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:48:47 devstack sudo[88438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dc75833f-19af-4f9f-8b27-0d7c314732e2 Nov 04 18:48:47 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:48:48 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root Nov 04 18:48:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dc75833f-19af-4f9f-8b27-0d7c314732e2" returned: 0 in 0.352s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:48:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:48:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:48:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.410s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:48:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1642436021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c427bb4-e300-4402-ba79-05346930e493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af69da288d19442a94446e0ad4dd3a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:48:48Z,use_quota=True,user_id='11d00b23857f4823aee04603f362120f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:48:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Creating volume 6c427bb4-e300-4402-ba79-05346930e493 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:48:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:48:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:48:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:48:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:48:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:48:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:48:48 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:48:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6c427bb4-e300-4402-ba79-05346930e493 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:48:48 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd567e0a-999c-4c6a-81c8-98be3886b19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc75833f-19af-4f9f-8b27-0d7c314732e2', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:48:48 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d8e5237-cbfe-4244-bbd2-9204afbccc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:48:48 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6c427bb4-e300-4402-ba79-05346930e493 1073741824 Nov 04 18:48:48 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:48:48 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Volume volume-dc75833f-19af-4f9f-8b27-0d7c314732e2 (dc75833f-19af-4f9f-8b27-0d7c314732e2): created successfully Nov 04 18:48:48 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d8e5237-cbfe-4244-bbd2-9204afbccc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:48:48 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Flow 'volume_create_manager' (55465219-97b4-4e32-9b72-b5445e0aea2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:48:48 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-bce5e25d-1eae-4162-9b37-bf0067f78864 tempest-ServerActionsTestOtherA-347787518 None] Created volume successfully. Nov 04 18:48:48 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Nov 04 18:48:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6c427bb4-e300-4402-ba79-05346930e493 1073741824" returned: 0 in 0.591s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:48:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6c427bb4-e300-4402-ba79-05346930e493 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:48:48 devstack sudo[88447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6c427bb4-e300-4402-ba79-05346930e493 Nov 04 18:48:48 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:48:49 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root Nov 04 18:48:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6c427bb4-e300-4402-ba79-05346930e493" returned: 0 in 0.287s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:48:49 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:48:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:48:49 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e7499bb-8612-40af-87e4-d9f64d11de13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c427bb4-e300-4402-ba79-05346930e493', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:48:49 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d9124a-85c3-498e-bc32-70d97bf13cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:48:49 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Volume volume-6c427bb4-e300-4402-ba79-05346930e493 (6c427bb4-e300-4402-ba79-05346930e493): created successfully Nov 04 18:48:49 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d9124a-85c3-498e-bc32-70d97bf13cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:48:49 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Flow 'volume_create_manager' (ab20d87e-27ec-4b20-a3cf-bc7d577c7b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:48:49 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-fcaef578-fc4f-45ad-87c6-f28aac801808 tempest-AttachVolumeShelveTestJSON-62074351 None] Created volume successfully. Nov 04 18:48:59 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:48:59 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=2,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:49:06 devstack cinder-volume[87119]: WARNING py.warnings [req-61e52116-5529-406a-870a-2bacea97bfc2 req-4263eb91-835f-4ccc-b2b1-79da27838234 tempest-AttachVolumeShelveTestJSON-62074351 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Nov 04 18:49:06 devstack cinder-volume[87119]: .first() Nov 04 18:49:06 devstack cinder-volume[87119]: Nov 04 18:49:06 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-61e52116-5529-406a-870a-2bacea97bfc2 req-4263eb91-835f-4ccc-b2b1-79da27838234 tempest-AttachVolumeShelveTestJSON-62074351 None] No connector for attachment c6d56827-c71a-497a-b8f7-df5c28fbe0ba; skipping storage backend terminate_connection call. {{(pid=87119) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 04 18:49:06 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-61e52116-5529-406a-870a-2bacea97bfc2 req-4263eb91-835f-4ccc-b2b1-79da27838234 tempest-AttachVolumeShelveTestJSON-62074351 None] Deleting attachment c6d56827-c71a-497a-b8f7-df5c28fbe0ba. {{(pid=87119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:49:14 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:49:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Flow 'volume_create_manager' (c45ed3b4-b5f0-4ad0-aed4-48c46ed5165d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:49:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b5b6f5a-c91d-4a96-9d66-000bdb85056c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:49:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b5b6f5a-c91d-4a96-9d66-000bdb85056c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-770094903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3cc2f90-3a6b-40ec-9cb0-65d37672e771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72e7ee5788c4241a92d04a7c7df74b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:49:15Z,use_quota=True,user_id='d7c6a1d5b07f463ea1e79a875763f35a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:49:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e0d314-5189-4b16-be56-2ee3925d549f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:49:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e0d314-5189-4b16-be56-2ee3925d549f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:49:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2adf7834-cf55-4c12-91c0-eed0582750f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:49:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2adf7834-cf55-4c12-91c0-eed0582750f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3cc2f90-3a6b-40ec-9cb0-65d37672e771', 'volume_name': 'volume-a3cc2f90-3a6b-40ec-9cb0-65d37672e771', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:49:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3595abc2-363f-4070-acc8-87cfb0bfd0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:49:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3595abc2-363f-4070-acc8-87cfb0bfd0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:49:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d724efad-ffc4-4d29-86d0-88739e5c0537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:49:14 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Volume a3cc2f90-3a6b-40ec-9cb0-65d37672e771: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3cc2f90-3a6b-40ec-9cb0-65d37672e771', 'volume_size': 1} Nov 04 18:49:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:49:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:49:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-770094903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3cc2f90-3a6b-40ec-9cb0-65d37672e771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72e7ee5788c4241a92d04a7c7df74b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:49:15Z,use_quota=True,user_id='d7c6a1d5b07f463ea1e79a875763f35a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:49:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Creating volume a3cc2f90-3a6b-40ec-9cb0-65d37672e771 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:49:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:49:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:49:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:49:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:49:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:49:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:49:14 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:49:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a3cc2f90-3a6b-40ec-9cb0-65d37672e771 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:49:14 devstack sudo[88580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a3cc2f90-3a6b-40ec-9cb0-65d37672e771 1073741824 Nov 04 18:49:14 devstack sudo[88580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:49:15 devstack sudo[88580]: pam_unix(sudo:session): session closed for user root Nov 04 18:49:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a3cc2f90-3a6b-40ec-9cb0-65d37672e771 1073741824" returned: 0 in 0.616s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:49:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a3cc2f90-3a6b-40ec-9cb0-65d37672e771 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:49:15 devstack sudo[88587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a3cc2f90-3a6b-40ec-9cb0-65d37672e771 Nov 04 18:49:15 devstack sudo[88587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:49:15 devstack sudo[88587]: pam_unix(sudo:session): session closed for user root Nov 04 18:49:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a3cc2f90-3a6b-40ec-9cb0-65d37672e771" returned: 0 in 0.352s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:49:15 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:49:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:49:15 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d724efad-ffc4-4d29-86d0-88739e5c0537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3cc2f90-3a6b-40ec-9cb0-65d37672e771', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:49:15 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3cffb6-4c0a-4691-b132-d2d73fad3a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:49:15 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Volume volume-a3cc2f90-3a6b-40ec-9cb0-65d37672e771 (a3cc2f90-3a6b-40ec-9cb0-65d37672e771): created successfully Nov 04 18:49:15 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3cffb6-4c0a-4691-b132-d2d73fad3a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:49:15 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Flow 'volume_create_manager' (c45ed3b4-b5f0-4ad0-aed4-48c46ed5165d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:49:15 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-c8c473ce-ec7c-4933-bc48-738910bc04c1 tempest-TaggedAttachmentsTest-1660803797 None] Created volume successfully. Nov 04 18:49:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:49:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:49:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:49:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:49:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:49:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:49:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:49:25 devstack sudo[88611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:49:25 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:49:25 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root Nov 04 18:49:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.520s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:49:25 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:49:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager._thread_info {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:49:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread count: 8 {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:49:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread info: [<_MainThread(MainThread, started 130247852032128)>, , , , , , , ] {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:49:25 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:49:25 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:49:37 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:49:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Flow 'volume_create_manager' (0d95d09f-5a4d-4fd0-9c40-fd23a70791a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:49:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f1a5c3c-3f0a-4085-9362-9e72313fe566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:49:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f1a5c3c-3f0a-4085-9362-9e72313fe566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1684371600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9dae8f9-d324-4db2-8a46-8e4b803dbd55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ebe631afe5b4dc795ce80c634978f8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:49:38Z,use_quota=True,user_id='4416a54d9b294020a445e5c1d96865b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:49:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f06e126e-ba88-4ad2-aade-9c786db76492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:49:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f06e126e-ba88-4ad2-aade-9c786db76492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:49:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10143f55-cdad-4a5e-ae69-a692ad0f25da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:49:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10143f55-cdad-4a5e-ae69-a692ad0f25da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9dae8f9-d324-4db2-8a46-8e4b803dbd55', 'volume_name': 'volume-b9dae8f9-d324-4db2-8a46-8e4b803dbd55', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:49:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b512c1db-f712-4077-a9ab-bb10b65bbf62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:49:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b512c1db-f712-4077-a9ab-bb10b65bbf62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:49:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71be81f1-d86a-4e9f-a013-1f7fedf44c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:49:37 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Volume b9dae8f9-d324-4db2-8a46-8e4b803dbd55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9dae8f9-d324-4db2-8a46-8e4b803dbd55', 'volume_size': 1} Nov 04 18:49:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:49:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:49:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1684371600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9dae8f9-d324-4db2-8a46-8e4b803dbd55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ebe631afe5b4dc795ce80c634978f8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:49:38Z,use_quota=True,user_id='4416a54d9b294020a445e5c1d96865b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:49:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Creating volume b9dae8f9-d324-4db2-8a46-8e4b803dbd55 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:49:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:49:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:49:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:49:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:49:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:49:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:49:37 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:49:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9dae8f9-d324-4db2-8a46-8e4b803dbd55 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:49:37 devstack sudo[88949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9dae8f9-d324-4db2-8a46-8e4b803dbd55 1073741824 Nov 04 18:49:37 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:49:38 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root Nov 04 18:49:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9dae8f9-d324-4db2-8a46-8e4b803dbd55 1073741824" returned: 0 in 1.024s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:49:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9dae8f9-d324-4db2-8a46-8e4b803dbd55 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:49:39 devstack sudo[88958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9dae8f9-d324-4db2-8a46-8e4b803dbd55 Nov 04 18:49:39 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:49:39 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root Nov 04 18:49:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9dae8f9-d324-4db2-8a46-8e4b803dbd55" returned: 0 in 0.443s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:49:39 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:49:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:49:39 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71be81f1-d86a-4e9f-a013-1f7fedf44c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9dae8f9-d324-4db2-8a46-8e4b803dbd55', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:49:39 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (011685e9-dfe6-418e-be97-6264cd59d268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:49:39 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Volume volume-b9dae8f9-d324-4db2-8a46-8e4b803dbd55 (b9dae8f9-d324-4db2-8a46-8e4b803dbd55): created successfully Nov 04 18:49:39 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (011685e9-dfe6-418e-be97-6264cd59d268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:49:39 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Flow 'volume_create_manager' (0d95d09f-5a4d-4fd0-9c40-fd23a70791a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:49:39 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e68f4f78-5765-4eb5-9a30-62f4a499c283 tempest-DeleteServersTestJSON-1123994727 None] Created volume successfully. Nov 04 18:49:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-9b21ca87-bbc5-410a-a0ca-f4b56bb4d654 req-db3da54f-7bd4-4b36-a929-9fafa8c90fcc tempest-DeleteServersTestJSON-1123994727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:49:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-9b21ca87-bbc5-410a-a0ca-f4b56bb4d654 req-db3da54f-7bd4-4b36-a929-9fafa8c90fcc tempest-DeleteServersTestJSON-1123994727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:49:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-9b21ca87-bbc5-410a-a0ca-f4b56bb4d654 req-db3da54f-7bd4-4b36-a929-9fafa8c90fcc tempest-DeleteServersTestJSON-1123994727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:49:44 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-9b21ca87-bbc5-410a-a0ca-f4b56bb4d654 req-db3da54f-7bd4-4b36-a929-9fafa8c90fcc tempest-DeleteServersTestJSON-1123994727 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280', 'name': 'volume-b9dae8f9-d324-4db2-8a46-8e4b803dbd55', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5c1d234-cac3-4889-b7f9-261e9a57dfcc', 'enforce_multipath': True} {{(pid=87119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:49:45 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-9b21ca87-bbc5-410a-a0ca-f4b56bb4d654 req-db3da54f-7bd4-4b36-a929-9fafa8c90fcc tempest-DeleteServersTestJSON-1123994727 None] attachment_update completed successfully. Nov 04 18:49:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-a36d6554-d4a9-4a15-87d0-467353f99f5b req-a08befa8-6443-4a98-a760-b62b0d817da2 tempest-ServerActionsTestOtherA-347787518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:49:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-a36d6554-d4a9-4a15-87d0-467353f99f5b req-a08befa8-6443-4a98-a760-b62b0d817da2 tempest-ServerActionsTestOtherA-347787518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:49:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-a36d6554-d4a9-4a15-87d0-467353f99f5b req-a08befa8-6443-4a98-a760-b62b0d817da2 tempest-ServerActionsTestOtherA-347787518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:49:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-a36d6554-d4a9-4a15-87d0-467353f99f5b req-a08befa8-6443-4a98-a760-b62b0d817da2 tempest-ServerActionsTestOtherA-347787518 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280', 'name': 'volume-dc75833f-19af-4f9f-8b27-0d7c314732e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0857fd85-83df-407c-acb5-85b8c5ab5e28', 'enforce_multipath': True} {{(pid=87119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:49:45 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-a36d6554-d4a9-4a15-87d0-467353f99f5b req-a08befa8-6443-4a98-a760-b62b0d817da2 tempest-ServerActionsTestOtherA-347787518 None] attachment_update completed successfully. Nov 04 18:49:50 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-827b0bc8-c6ee-42bf-a5a9-42e7319ea94a req-35f10b8a-580b-4d77-906b-3dfc26c62d51 tempest-ServerActionsTestOtherA-347787518 None] Terminate volume connection completed successfully. Nov 04 18:49:50 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-827b0bc8-c6ee-42bf-a5a9-42e7319ea94a req-35f10b8a-580b-4d77-906b-3dfc26c62d51 tempest-ServerActionsTestOtherA-347787518 None] Deleting attachment 0857fd85-83df-407c-acb5-85b8c5ab5e28. {{(pid=87119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:49:51 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-7c601f19-b5b2-4698-a55a-f4566e186132 req-b5e24174-b41b-4f6a-8939-ef9dd0ed2e0a tempest-DeleteServersTestJSON-1123994727 None] Terminate volume connection completed successfully. Nov 04 18:49:51 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-7c601f19-b5b2-4698-a55a-f4566e186132 req-b5e24174-b41b-4f6a-8939-ef9dd0ed2e0a tempest-DeleteServersTestJSON-1123994727 None] Deleting attachment e5c1d234-cac3-4889-b7f9-261e9a57dfcc. {{(pid=87119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:49:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-827b0bc8-c6ee-42bf-a5a9-42e7319ea94a req-734e38de-3fb6-44a6-b704-907857f2c335 tempest-ServerActionsTestOtherA-347787518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:49:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-827b0bc8-c6ee-42bf-a5a9-42e7319ea94a req-734e38de-3fb6-44a6-b704-907857f2c335 tempest-ServerActionsTestOtherA-347787518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:49:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-827b0bc8-c6ee-42bf-a5a9-42e7319ea94a req-734e38de-3fb6-44a6-b704-907857f2c335 tempest-ServerActionsTestOtherA-347787518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:49:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-827b0bc8-c6ee-42bf-a5a9-42e7319ea94a req-734e38de-3fb6-44a6-b704-907857f2c335 tempest-ServerActionsTestOtherA-347787518 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280', 'name': 'volume-dc75833f-19af-4f9f-8b27-0d7c314732e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b4cd129-3320-40b4-8f4a-2696dacd5526', 'enforce_multipath': True} {{(pid=87119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:49:52 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-827b0bc8-c6ee-42bf-a5a9-42e7319ea94a req-734e38de-3fb6-44a6-b704-907857f2c335 tempest-ServerActionsTestOtherA-347787518 None] attachment_update completed successfully. Nov 04 18:49:54 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ff31d8b6-cdbd-45aa-99fc-ac5e21c548ed tempest-DeleteServersTestJSON-1123994727 None] Acquiring lock "cinder-b9dae8f9-d324-4db2-8a46-8e4b803dbd55-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:49:54 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ff31d8b6-cdbd-45aa-99fc-ac5e21c548ed tempest-DeleteServersTestJSON-1123994727 None] Lock "cinder-b9dae8f9-d324-4db2-8a46-8e4b803dbd55-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:49:54 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ff31d8b6-cdbd-45aa-99fc-ac5e21c548ed tempest-DeleteServersTestJSON-1123994727 None] Acquiring lock "cinder-quobyte-b9dae8f9-d324-4db2-8a46-8e4b803dbd55" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:49:54 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ff31d8b6-cdbd-45aa-99fc-ac5e21c548ed tempest-DeleteServersTestJSON-1123994727 None] Lock "cinder-quobyte-b9dae8f9-d324-4db2-8a46-8e4b803dbd55" acquired by "delete_volume" :: waited 0.025s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:49:54 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4676b2a-278d-40cc-b9a0-0d56d49c8307]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:49:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ff31d8b6-cdbd-45aa-99fc-ac5e21c548ed tempest-DeleteServersTestJSON-1123994727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9dae8f9-d324-4db2-8a46-8e4b803dbd55 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:49:54 devstack sudo[89992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9dae8f9-d324-4db2-8a46-8e4b803dbd55 Nov 04 18:49:54 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:49:55 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root Nov 04 18:49:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ff31d8b6-cdbd-45aa-99fc-ac5e21c548ed tempest-DeleteServersTestJSON-1123994727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9dae8f9-d324-4db2-8a46-8e4b803dbd55" returned: 0 in 0.362s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:49:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ff31d8b6-cdbd-45aa-99fc-ac5e21c548ed tempest-DeleteServersTestJSON-1123994727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9dae8f9-d324-4db2-8a46-8e4b803dbd55 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:49:55 devstack sudo[89997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9dae8f9-d324-4db2-8a46-8e4b803dbd55 Nov 04 18:49:55 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:49:55 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root Nov 04 18:49:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ff31d8b6-cdbd-45aa-99fc-ac5e21c548ed tempest-DeleteServersTestJSON-1123994727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9dae8f9-d324-4db2-8a46-8e4b803dbd55" returned: 0 in 0.266s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:49:55 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ff31d8b6-cdbd-45aa-99fc-ac5e21c548ed tempest-DeleteServersTestJSON-1123994727 None] Lock "cinder-quobyte-b9dae8f9-d324-4db2-8a46-8e4b803dbd55" released by "delete_volume" :: held 0.682s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:49:55 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-ff31d8b6-cdbd-45aa-99fc-ac5e21c548ed tempest-DeleteServersTestJSON-1123994727 None] Created reservations ['3567d6c0-e21f-49b9-beff-2098697e2b93', '266a362f-6f47-4a66-9e6a-6adb0afffeb4', '40b09475-3a05-42a7-9e51-bf602cfcc58c', '4f569452-defa-4af7-9d22-4de4fb34cd69'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:49:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ff31d8b6-cdbd-45aa-99fc-ac5e21c548ed tempest-DeleteServersTestJSON-1123994727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:49:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ff31d8b6-cdbd-45aa-99fc-ac5e21c548ed tempest-DeleteServersTestJSON-1123994727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:49:55 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ff31d8b6-cdbd-45aa-99fc-ac5e21c548ed tempest-DeleteServersTestJSON-1123994727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:49:55 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ff31d8b6-cdbd-45aa-99fc-ac5e21c548ed tempest-DeleteServersTestJSON-1123994727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:49:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ff31d8b6-cdbd-45aa-99fc-ac5e21c548ed tempest-DeleteServersTestJSON-1123994727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:49:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ff31d8b6-cdbd-45aa-99fc-ac5e21c548ed tempest-DeleteServersTestJSON-1123994727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:49:55 devstack sudo[90002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:49:55 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:49:56 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root Nov 04 18:49:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ff31d8b6-cdbd-45aa-99fc-ac5e21c548ed tempest-DeleteServersTestJSON-1123994727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.654s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:49:56 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-ff31d8b6-cdbd-45aa-99fc-ac5e21c548ed tempest-DeleteServersTestJSON-1123994727 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:49:56 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-ff31d8b6-cdbd-45aa-99fc-ac5e21c548ed tempest-DeleteServersTestJSON-1123994727 None] Deleted volume successfully. Nov 04 18:49:56 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ff31d8b6-cdbd-45aa-99fc-ac5e21c548ed tempest-DeleteServersTestJSON-1123994727 None] Lock "cinder-b9dae8f9-d324-4db2-8a46-8e4b803dbd55-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:50:05 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=25,cinder:INSERT=3,cinder:UPDATE=14 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:50:06 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:UPDATE=17,cinder:SELECT=32,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:50:18 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-95d14a7b-8e6c-48c6-bb85-437f4cfd8d04 tempest-AttachVolumeShelveTestJSON-62074351 None] Acquiring lock "cinder-6c427bb4-e300-4402-ba79-05346930e493-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:50:18 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-95d14a7b-8e6c-48c6-bb85-437f4cfd8d04 tempest-AttachVolumeShelveTestJSON-62074351 None] Lock "cinder-6c427bb4-e300-4402-ba79-05346930e493-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:50:18 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-95d14a7b-8e6c-48c6-bb85-437f4cfd8d04 tempest-AttachVolumeShelveTestJSON-62074351 None] Acquiring lock "cinder-quobyte-6c427bb4-e300-4402-ba79-05346930e493" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:50:18 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-95d14a7b-8e6c-48c6-bb85-437f4cfd8d04 tempest-AttachVolumeShelveTestJSON-62074351 None] Lock "cinder-quobyte-6c427bb4-e300-4402-ba79-05346930e493" acquired by "delete_volume" :: waited 0.022s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:50:19 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c24717-ad78-431e-b9df-28434f73c798]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:50:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-95d14a7b-8e6c-48c6-bb85-437f4cfd8d04 tempest-AttachVolumeShelveTestJSON-62074351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6c427bb4-e300-4402-ba79-05346930e493 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:19 devstack sudo[90202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6c427bb4-e300-4402-ba79-05346930e493 Nov 04 18:50:19 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:19 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-95d14a7b-8e6c-48c6-bb85-437f4cfd8d04 tempest-AttachVolumeShelveTestJSON-62074351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6c427bb4-e300-4402-ba79-05346930e493" returned: 0 in 0.690s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-95d14a7b-8e6c-48c6-bb85-437f4cfd8d04 tempest-AttachVolumeShelveTestJSON-62074351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6c427bb4-e300-4402-ba79-05346930e493 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:19 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6c427bb4-e300-4402-ba79-05346930e493 Nov 04 18:50:19 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:20 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-95d14a7b-8e6c-48c6-bb85-437f4cfd8d04 tempest-AttachVolumeShelveTestJSON-62074351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6c427bb4-e300-4402-ba79-05346930e493" returned: 0 in 0.379s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:20 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-95d14a7b-8e6c-48c6-bb85-437f4cfd8d04 tempest-AttachVolumeShelveTestJSON-62074351 None] Lock "cinder-quobyte-6c427bb4-e300-4402-ba79-05346930e493" released by "delete_volume" :: held 1.147s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:50:20 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-95d14a7b-8e6c-48c6-bb85-437f4cfd8d04 tempest-AttachVolumeShelveTestJSON-62074351 None] Created reservations ['f7620998-4ab0-401b-a0bc-7f15dea095d6', 'a0d0e51d-c39a-49f3-a7ff-37b787c12f81', '85e620ac-0a76-4e6d-b931-996c9332e5b9', 'a6f1b0fb-0be3-4b5f-98cd-84992a46daf6'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:50:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-95d14a7b-8e6c-48c6-bb85-437f4cfd8d04 tempest-AttachVolumeShelveTestJSON-62074351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:50:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-95d14a7b-8e6c-48c6-bb85-437f4cfd8d04 tempest-AttachVolumeShelveTestJSON-62074351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:50:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-95d14a7b-8e6c-48c6-bb85-437f4cfd8d04 tempest-AttachVolumeShelveTestJSON-62074351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:50:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-95d14a7b-8e6c-48c6-bb85-437f4cfd8d04 tempest-AttachVolumeShelveTestJSON-62074351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:50:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-95d14a7b-8e6c-48c6-bb85-437f4cfd8d04 tempest-AttachVolumeShelveTestJSON-62074351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:50:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-95d14a7b-8e6c-48c6-bb85-437f4cfd8d04 tempest-AttachVolumeShelveTestJSON-62074351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:20 devstack sudo[90277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:50:20 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:20 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-95d14a7b-8e6c-48c6-bb85-437f4cfd8d04 tempest-AttachVolumeShelveTestJSON-62074351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.420s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:20 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-95d14a7b-8e6c-48c6-bb85-437f4cfd8d04 tempest-AttachVolumeShelveTestJSON-62074351 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:50:20 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-95d14a7b-8e6c-48c6-bb85-437f4cfd8d04 tempest-AttachVolumeShelveTestJSON-62074351 None] Deleted volume successfully. Nov 04 18:50:20 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-95d14a7b-8e6c-48c6-bb85-437f4cfd8d04 tempest-AttachVolumeShelveTestJSON-62074351 None] Lock "cinder-6c427bb4-e300-4402-ba79-05346930e493-delete_volume" released by "delete_volume" :: held 2.051s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:50:23 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-5e465f31-d203-4825-9caf-02ab8229de4b req-4712444b-2f0c-479a-9f9e-9385b828c59e tempest-ServerActionsTestOtherA-347787518 None] Terminate volume connection completed successfully. Nov 04 18:50:23 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-5e465f31-d203-4825-9caf-02ab8229de4b req-4712444b-2f0c-479a-9f9e-9385b828c59e tempest-ServerActionsTestOtherA-347787518 None] Deleting attachment 2b4cd129-3320-40b4-8f4a-2696dacd5526. {{(pid=87119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:50:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:50:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:50:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:50:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:50:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:50:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:50:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:25 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:50:25 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:25 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.637s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:25 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:50:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-5653f3bb-dbf7-4a01-8706-fb2f3ed57c2b req-513946bf-4486-4d55-a728-287355c6d988 tempest-TaggedAttachmentsTest-1660803797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:50:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-5653f3bb-dbf7-4a01-8706-fb2f3ed57c2b req-513946bf-4486-4d55-a728-287355c6d988 tempest-TaggedAttachmentsTest-1660803797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:50:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-5653f3bb-dbf7-4a01-8706-fb2f3ed57c2b req-513946bf-4486-4d55-a728-287355c6d988 tempest-TaggedAttachmentsTest-1660803797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:50:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-5653f3bb-dbf7-4a01-8706-fb2f3ed57c2b req-513946bf-4486-4d55-a728-287355c6d988 tempest-TaggedAttachmentsTest-1660803797 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280', 'name': 'volume-a3cc2f90-3a6b-40ec-9cb0-65d37672e771', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9c8f1f98-437b-4c68-816e-2a5a1433b660', 'enforce_multipath': True} {{(pid=87119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:50:33 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-5653f3bb-dbf7-4a01-8706-fb2f3ed57c2b req-513946bf-4486-4d55-a728-287355c6d988 tempest-TaggedAttachmentsTest-1660803797 None] attachment_update completed successfully. Nov 04 18:50:37 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-562f4669-8ca4-4dbe-87aa-674086f39445 req-c9b3bdae-0470-4af5-a38b-0aeec842c511 tempest-TaggedAttachmentsTest-1660803797 None] Terminate volume connection completed successfully. Nov 04 18:50:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-562f4669-8ca4-4dbe-87aa-674086f39445 req-c9b3bdae-0470-4af5-a38b-0aeec842c511 tempest-TaggedAttachmentsTest-1660803797 None] Deleting attachment 9c8f1f98-437b-4c68-816e-2a5a1433b660. {{(pid=87119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:50:37 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:50:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Flow 'volume_create_manager' (00e109cc-a813-4446-8f3f-9c21f5a7334c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:50:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f9bdbf-9ef3-4334-a775-b03253d95cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:50:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f9bdbf-9ef3-4334-a775-b03253d95cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-580004900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8632603-f2e3-4e38-88d1-40121b5912ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4801e0ce4d47da98d5b5c2710d50a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:50:38Z,use_quota=True,user_id='9781f272e19b4fcda6fd614b14fa079e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:50:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcbcafa7-6df2-4b77-9010-f236e0e13a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:50:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcbcafa7-6df2-4b77-9010-f236e0e13a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:50:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e946511-4057-434e-a655-ac65b341f9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:50:38 devstack cinder-volume[87119]: DEBUG cinder.image.glance [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Creating Keystone auth plugin from conf {{(pid=87119) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 18:50:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e946511-4057-434e-a655-ac65b341f9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd8632603-f2e3-4e38-88d1-40121b5912ca', 'volume_name': 'volume-d8632603-f2e3-4e38-88d1-40121b5912ca', 'volume_size': 1, 'image_id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '184bff60e125442790f1bc12f0dfbe3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'created_at': datetime.datetime(2026, 11, 4, 17, 42, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:50:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c5bae28-565c-401c-b377-69c208fbaf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:50:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c5bae28-565c-401c-b377-69c208fbaf98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:50:41 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e568e2-ba95-4a98-bbae-9d59642b4b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:50:41 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Volume d8632603-f2e3-4e38-88d1-40121b5912ca: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d8632603-f2e3-4e38-88d1-40121b5912ca', 'volume_size': 1, 'image_id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '184bff60e125442790f1bc12f0dfbe3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'created_at': datetime.datetime(2026, 11, 4, 17, 42, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 18:50:41 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Trying to clone d8632603-f2e3-4e38-88d1-40121b5912ca from image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d at location (None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}]). {{(pid=87119) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 18:50:41 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_4qertrlydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 18:50:41 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Image download 20.69 MB at 20.69 MB/s Nov 04 18:50:42 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0df970-36af-4f9a-86df-8b3959ed1092]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:50:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_4qertrlydevstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:42 devstack sudo[91026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_4qertrlydevstack@QuobyteHD Nov 04 18:50:42 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:42 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_4qertrlydevstack@QuobyteHD" returned: 0 in 0.609s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:42 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Temporary image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d is fetched for user 9781f272e19b4fcda6fd614b14fa079e. {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 18:50:42 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:50:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Flow 'volume_create_manager' (8b00da93-0c47-4039-abba-47ad57d05239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:50:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (708c77da-fbdc-43fa-baa0-00739af367e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:50:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (708c77da-fbdc-43fa-baa0-00739af367e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-667146467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a0c899-0291-49fb-87a0-7be14b45e170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8b1a0fb2f54aee903e5f87cf5b742f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:50:43Z,use_quota=True,user_id='a2c91bf6bc2f4a48b0ed60b5b3781598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:50:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e42eab-b5a8-4268-8189-8a4fcfcc97c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:50:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e42eab-b5a8-4268-8189-8a4fcfcc97c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:50:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b6d5df7-646e-4459-9eea-083627b4913c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:50:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b6d5df7-646e-4459-9eea-083627b4913c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0a0c899-0291-49fb-87a0-7be14b45e170', 'volume_name': 'volume-c0a0c899-0291-49fb-87a0-7be14b45e170', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:50:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f706975a-3ae1-4c82-881e-31c484b10b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:50:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f706975a-3ae1-4c82-881e-31c484b10b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:50:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffcc65d6-ae27-46fa-ad32-90baa41ff679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:50:42 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Volume c0a0c899-0291-49fb-87a0-7be14b45e170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0a0c899-0291-49fb-87a0-7be14b45e170', 'volume_size': 1} Nov 04 18:50:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:50:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:50:42 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-667146467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a0c899-0291-49fb-87a0-7be14b45e170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8b1a0fb2f54aee903e5f87cf5b742f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:50:43Z,use_quota=True,user_id='a2c91bf6bc2f4a48b0ed60b5b3781598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:50:42 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Creating volume c0a0c899-0291-49fb-87a0-7be14b45e170 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:50:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:50:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:50:42 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:50:42 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:50:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:50:42 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:50:42 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:50:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c0a0c899-0291-49fb-87a0-7be14b45e170 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:43 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:50:43 devstack sudo[91033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c0a0c899-0291-49fb-87a0-7be14b45e170 1073741824 Nov 04 18:50:43 devstack sudo[91033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Flow 'volume_create_manager' (b9358883-23e1-4aea-bf56-184422cb0e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:50:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27242076-195a-4273-92d7-bbcc819ca99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:50:43 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37def47-c98d-43a5-bf52-75747943dd10]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:50:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_4qertrlydevstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27242076-195a-4273-92d7-bbcc819ca99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-502879350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31eaf344-45be-4657-8c46-aed7e4334c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f822c99ce3074f71b4c84d3cb883b27c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:50:43Z,use_quota=True,user_id='a8943497c1604a15a0338aafb7f463c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:50:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65de011c-ff11-434e-896e-0eca433f0868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:50:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65de011c-ff11-434e-896e-0eca433f0868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:50:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9796a53c-dc9b-463f-a51a-219e7a3ec6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:50:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9796a53c-dc9b-463f-a51a-219e7a3ec6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31eaf344-45be-4657-8c46-aed7e4334c8c', 'volume_name': 'volume-31eaf344-45be-4657-8c46-aed7e4334c8c', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:50:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f31432-62f1-48a3-a96a-fa891253a620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:50:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f31432-62f1-48a3-a96a-fa891253a620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:50:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa091d5-ea5c-4dfe-8e28-e15dc782b3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:50:43 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Volume 31eaf344-45be-4657-8c46-aed7e4334c8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31eaf344-45be-4657-8c46-aed7e4334c8c', 'volume_size': 1} Nov 04 18:50:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:50:43 devstack sudo[91036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_4qertrlydevstack@QuobyteHD Nov 04 18:50:43 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:43 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_4qertrlydevstack@QuobyteHD" returned: 0 in 0.608s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:50:43 devstack sudo[91033]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c0a0c899-0291-49fb-87a0-7be14b45e170 1073741824" returned: 0 in 0.793s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c0a0c899-0291-49fb-87a0-7be14b45e170 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:43 devstack sudo[91045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c0a0c899-0291-49fb-87a0-7be14b45e170 Nov 04 18:50:43 devstack sudo[91045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:44 devstack sudo[91045]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c0a0c899-0291-49fb-87a0-7be14b45e170" returned: 0 in 0.397s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:44 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:50:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:50:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.041s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:50:44 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-502879350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31eaf344-45be-4657-8c46-aed7e4334c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f822c99ce3074f71b4c84d3cb883b27c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:50:43Z,use_quota=True,user_id='a8943497c1604a15a0338aafb7f463c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:50:44 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Creating volume 31eaf344-45be-4657-8c46-aed7e4334c8c {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:50:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:50:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:50:44 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:50:44 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:50:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:50:44 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:50:44 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:50:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:44 devstack sudo[91048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c 1073741824 Nov 04 18:50:44 devstack sudo[91048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:44 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffcc65d6-ae27-46fa-ad32-90baa41ff679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0a0c899-0291-49fb-87a0-7be14b45e170', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:50:44 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa00d877-1c93-4d7e-a8ca-b052f848aa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:50:44 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Volume volume-c0a0c899-0291-49fb-87a0-7be14b45e170 (c0a0c899-0291-49fb-87a0-7be14b45e170): created successfully Nov 04 18:50:44 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa00d877-1c93-4d7e-a8ca-b052f848aa5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:50:44 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Flow 'volume_create_manager' (8b00da93-0c47-4039-abba-47ad57d05239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:50:44 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-44feab44-cbe4-4854-a640-2a9d7d040aa4 tempest-ServerRescueNegativeTestJSON-1564823756 None] Created volume successfully. Nov 04 18:50:45 devstack sudo[91048]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c 1073741824" returned: 0 in 0.875s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:45 devstack sudo[91055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c Nov 04 18:50:45 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:45 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c" returned: 0 in 0.609s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:50:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:50:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.150s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:50:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-580004900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8632603-f2e3-4e38-88d1-40121b5912ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4801e0ce4d47da98d5b5c2710d50a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:50:38Z,use_quota=True,user_id='9781f272e19b4fcda6fd614b14fa079e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:50:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Creating volume d8632603-f2e3-4e38-88d1-40121b5912ca {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:50:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:50:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:50:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:50:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:50:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:50:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:50:45 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:50:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d8632603-f2e3-4e38-88d1-40121b5912ca 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:45 devstack sudo[91059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d8632603-f2e3-4e38-88d1-40121b5912ca 1073741824 Nov 04 18:50:45 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa091d5-ea5c-4dfe-8e28-e15dc782b3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31eaf344-45be-4657-8c46-aed7e4334c8c', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:50:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3dff47d-85d7-4278-a175-c6bd3264791d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:50:46 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Volume volume-31eaf344-45be-4657-8c46-aed7e4334c8c (31eaf344-45be-4657-8c46-aed7e4334c8c): created successfully Nov 04 18:50:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3dff47d-85d7-4278-a175-c6bd3264791d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:50:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Flow 'volume_create_manager' (b9358883-23e1-4aea-bf56-184422cb0e2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:50:46 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-475ec153-fa06-4600-ac29-d6c78b7f8fb5 req-65ad6385-4a34-413b-9251-936d69be06da tempest-VolumesSnapshotsTestJSON-431104583 None] Created volume successfully. Nov 04 18:50:47 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d8632603-f2e3-4e38-88d1-40121b5912ca 1073741824" returned: 0 in 1.158s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d8632603-f2e3-4e38-88d1-40121b5912ca {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:47 devstack sudo[91093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d8632603-f2e3-4e38-88d1-40121b5912ca Nov 04 18:50:47 devstack sudo[91093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:47 devstack sudo[91093]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d8632603-f2e3-4e38-88d1-40121b5912ca" returned: 0 in 0.379s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:50:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:50:47 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Attempting download of 1353e8e0-d342-427e-a3b6-10b6f6b08d2d ((None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}])) to volume d8632603-f2e3-4e38-88d1-40121b5912ca. {{(pid=87119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 18:50:47 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a7c986-bd10-4a42-9a4e-010aab79570e]: (4, 'raw') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:50:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_qrgw71ro {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:47 devstack sudo[91104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_qrgw71ro Nov 04 18:50:47 devstack sudo[91104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-975952cf-e4d6-46db-8923-2f371519c5c2 req-41fcb9da-030d-4857-af03-e56f94c9dcb7 tempest-VolumesSnapshotsTestJSON-431104583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:50:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-975952cf-e4d6-46db-8923-2f371519c5c2 req-41fcb9da-030d-4857-af03-e56f94c9dcb7 tempest-VolumesSnapshotsTestJSON-431104583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:50:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [req-975952cf-e4d6-46db-8923-2f371519c5c2 req-41fcb9da-030d-4857-af03-e56f94c9dcb7 tempest-VolumesSnapshotsTestJSON-431104583 None] Creating offline snapshot 82e2af12-b1f7-428a-840c-65e7cef31672 of volume 31eaf344-45be-4657-8c46-aed7e4334c8c {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:50:48 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6b491a-8164-4e25-ba3f-78bbe07685e2]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:50:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-975952cf-e4d6-46db-8923-2f371519c5c2 req-41fcb9da-030d-4857-af03-e56f94c9dcb7 tempest-VolumesSnapshotsTestJSON-431104583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:48 devstack sudo[91109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c Nov 04 18:50:48 devstack sudo[91109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:48 devstack sudo[91104]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_qrgw71ro" returned: 0 in 0.839s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_qrgw71ro {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:48 devstack sudo[91125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_qrgw71ro Nov 04 18:50:48 devstack sudo[91125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:48 devstack sudo[91109]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-975952cf-e4d6-46db-8923-2f371519c5c2 req-41fcb9da-030d-4857-af03-e56f94c9dcb7 tempest-VolumesSnapshotsTestJSON-431104583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c" returned: 0 in 0.754s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-975952cf-e4d6-46db-8923-2f371519c5c2 req-41fcb9da-030d-4857-af03-e56f94c9dcb7 tempest-VolumesSnapshotsTestJSON-431104583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c.82e2af12-b1f7-428a-840c-65e7cef31672 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:48 devstack sudo[91140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c.82e2af12-b1f7-428a-840c-65e7cef31672 1G Nov 04 18:50:48 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:49 devstack sudo[91125]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_qrgw71ro" returned: 1 in 0.974s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_qrgw71ro' failed. Not Retrying. {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 18:50:49 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[21952729-d6b2-4493-8b43-002e977e2da5]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:50:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_4qertrlydevstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:49 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-975952cf-e4d6-46db-8923-2f371519c5c2 req-41fcb9da-030d-4857-af03-e56f94c9dcb7 tempest-VolumesSnapshotsTestJSON-431104583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c.82e2af12-b1f7-428a-840c-65e7cef31672 1G" returned: 0 in 0.805s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-975952cf-e4d6-46db-8923-2f371519c5c2 req-41fcb9da-030d-4857-af03-e56f94c9dcb7 tempest-VolumesSnapshotsTestJSON-431104583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31eaf344-45be-4657-8c46-aed7e4334c8c -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c.82e2af12-b1f7-428a-840c-65e7cef31672 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:49 devstack sudo[91151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_4qertrlydevstack@QuobyteHD Nov 04 18:50:49 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:49 devstack sudo[91153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31eaf344-45be-4657-8c46-aed7e4334c8c -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c.82e2af12-b1f7-428a-840c-65e7cef31672 Nov 04 18:50:49 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:50 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_4qertrlydevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:50 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] 1353e8e0-d342-427e-a3b6-10b6f6b08d2d was qcow2, converting to qcow2 {{(pid=87119) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 18:50:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_4qertrlydevstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d8632603-f2e3-4e38-88d1-40121b5912ca {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:50 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_4qertrlydevstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d8632603-f2e3-4e38-88d1-40121b5912ca Nov 04 18:50:50 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:50 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-975952cf-e4d6-46db-8923-2f371519c5c2 req-41fcb9da-030d-4857-af03-e56f94c9dcb7 tempest-VolumesSnapshotsTestJSON-431104583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31eaf344-45be-4657-8c46-aed7e4334c8c -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c.82e2af12-b1f7-428a-840c-65e7cef31672" returned: 0 in 0.816s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:50 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [req-975952cf-e4d6-46db-8923-2f371519c5c2 req-41fcb9da-030d-4857-af03-e56f94c9dcb7 tempest-VolumesSnapshotsTestJSON-431104583 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c.82e2af12-b1f7-428a-840c-65e7cef31672 is being set with open permissions: ugo+rw Nov 04 18:50:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-975952cf-e4d6-46db-8923-2f371519c5c2 req-41fcb9da-030d-4857-af03-e56f94c9dcb7 tempest-VolumesSnapshotsTestJSON-431104583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c.82e2af12-b1f7-428a-840c-65e7cef31672 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:50 devstack sudo[91171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c.82e2af12-b1f7-428a-840c-65e7cef31672 Nov 04 18:50:50 devstack sudo[91171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:51 devstack sudo[91171]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-975952cf-e4d6-46db-8923-2f371519c5c2 req-41fcb9da-030d-4857-af03-e56f94c9dcb7 tempest-VolumesSnapshotsTestJSON-431104583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c.82e2af12-b1f7-428a-840c-65e7cef31672" returned: 0 in 0.576s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-975952cf-e4d6-46db-8923-2f371519c5c2 req-41fcb9da-030d-4857-af03-e56f94c9dcb7 tempest-VolumesSnapshotsTestJSON-431104583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:51 devstack sudo[91177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c.info Nov 04 18:50:51 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:51 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-975952cf-e4d6-46db-8923-2f371519c5c2 req-41fcb9da-030d-4857-af03-e56f94c9dcb7 tempest-VolumesSnapshotsTestJSON-431104583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c.info" returned: 0 in 0.296s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:51 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [req-975952cf-e4d6-46db-8923-2f371519c5c2 req-41fcb9da-030d-4857-af03-e56f94c9dcb7 tempest-VolumesSnapshotsTestJSON-431104583 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c.info is being set with open permissions: ugo+rw Nov 04 18:50:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-975952cf-e4d6-46db-8923-2f371519c5c2 req-41fcb9da-030d-4857-af03-e56f94c9dcb7 tempest-VolumesSnapshotsTestJSON-431104583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:51 devstack sudo[91184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c.info Nov 04 18:50:51 devstack sudo[91184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:51 devstack sudo[91184]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-975952cf-e4d6-46db-8923-2f371519c5c2 req-41fcb9da-030d-4857-af03-e56f94c9dcb7 tempest-VolumesSnapshotsTestJSON-431104583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c.info" returned: 0 in 0.395s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-975952cf-e4d6-46db-8923-2f371519c5c2 req-41fcb9da-030d-4857-af03-e56f94c9dcb7 tempest-VolumesSnapshotsTestJSON-431104583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.847s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:50:51 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-975952cf-e4d6-46db-8923-2f371519c5c2 req-41fcb9da-030d-4857-af03-e56f94c9dcb7 tempest-VolumesSnapshotsTestJSON-431104583 None] Create snapshot completed successfully Nov 04 18:50:52 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-51968a19-3334-4c2d-9a9a-2f60f7002d48 req-a7960404-bf4e-4eac-9823-0cd6ec0c72ea tempest-VolumesSnapshotsTestJSON-431104583 None] Acquiring lock "cinder-82e2af12-b1f7-428a-840c-65e7cef31672-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:50:52 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-51968a19-3334-4c2d-9a9a-2f60f7002d48 req-a7960404-bf4e-4eac-9823-0cd6ec0c72ea tempest-VolumesSnapshotsTestJSON-431104583 None] Lock "cinder-82e2af12-b1f7-428a-840c-65e7cef31672-delete_snapshot" acquired by "delete_snapshot" :: waited 0.079s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:50:52 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-51968a19-3334-4c2d-9a9a-2f60f7002d48 req-a7960404-bf4e-4eac-9823-0cd6ec0c72ea tempest-VolumesSnapshotsTestJSON-431104583 None] Acquiring lock "cinder-quobyte-31eaf344-45be-4657-8c46-aed7e4334c8c" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:50:52 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-51968a19-3334-4c2d-9a9a-2f60f7002d48 req-a7960404-bf4e-4eac-9823-0cd6ec0c72ea tempest-VolumesSnapshotsTestJSON-431104583 None] Lock "cinder-quobyte-31eaf344-45be-4657-8c46-aed7e4334c8c" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:50:52 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-51968a19-3334-4c2d-9a9a-2f60f7002d48 req-a7960404-bf4e-4eac-9823-0cd6ec0c72ea tempest-VolumesSnapshotsTestJSON-431104583 None] Acquiring lock "cinder-quobyte-82e2af12-b1f7-428a-840c-65e7cef31672" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:50:52 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-51968a19-3334-4c2d-9a9a-2f60f7002d48 req-a7960404-bf4e-4eac-9823-0cd6ec0c72ea tempest-VolumesSnapshotsTestJSON-431104583 None] Lock "cinder-quobyte-82e2af12-b1f7-428a-840c-65e7cef31672" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:50:52 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [req-51968a19-3334-4c2d-9a9a-2f60f7002d48 req-a7960404-bf4e-4eac-9823-0cd6ec0c72ea tempest-VolumesSnapshotsTestJSON-431104583 None] Deleting offline snapshot 82e2af12-b1f7-428a-840c-65e7cef31672 of volume 31eaf344-45be-4657-8c46-aed7e4334c8c {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:50:52 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [req-51968a19-3334-4c2d-9a9a-2f60f7002d48 req-a7960404-bf4e-4eac-9823-0cd6ec0c72ea tempest-VolumesSnapshotsTestJSON-431104583 None] snapshot_file for this snap is: volume-31eaf344-45be-4657-8c46-aed7e4334c8c.82e2af12-b1f7-428a-840c-65e7cef31672 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:50:52 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cff3a3-4dd5-40d0-b7a6-647cafd13d59]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:50:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-51968a19-3334-4c2d-9a9a-2f60f7002d48 req-a7960404-bf4e-4eac-9823-0cd6ec0c72ea tempest-VolumesSnapshotsTestJSON-431104583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c.82e2af12-b1f7-428a-840c-65e7cef31672 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:52 devstack sudo[91217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c.82e2af12-b1f7-428a-840c-65e7cef31672 Nov 04 18:50:52 devstack sudo[91217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:53 devstack sudo[91217]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-51968a19-3334-4c2d-9a9a-2f60f7002d48 req-a7960404-bf4e-4eac-9823-0cd6ec0c72ea tempest-VolumesSnapshotsTestJSON-431104583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c.82e2af12-b1f7-428a-840c-65e7cef31672" returned: 0 in 0.530s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:53 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [req-51968a19-3334-4c2d-9a9a-2f60f7002d48 req-a7960404-bf4e-4eac-9823-0cd6ec0c72ea tempest-VolumesSnapshotsTestJSON-431104583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31eaf344-45be-4657-8c46-aed7e4334c8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:50:53 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[35032369-95f6-4653-a582-0f92126e9f6c]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:50:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-51968a19-3334-4c2d-9a9a-2f60f7002d48 req-a7960404-bf4e-4eac-9823-0cd6ec0c72ea tempest-VolumesSnapshotsTestJSON-431104583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:53 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_4qertrlydevstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d8632603-f2e3-4e38-88d1-40121b5912ca" returned: 0 in 3.048s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:53 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_4qertrlydevstack@QuobyteHD, size 112.00 MB, duration 3.05 sec, destination /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d8632603-f2e3-4e38-88d1-40121b5912ca {{(pid=87119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 18:50:53 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Converted 112.00 MB image at 36.73 MB/s Nov 04 18:50:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d8632603-f2e3-4e38-88d1-40121b5912ca 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:53 devstack sudo[91224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d8632603-f2e3-4e38-88d1-40121b5912ca 1G Nov 04 18:50:53 devstack sudo[91224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:53 devstack sudo[91222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c Nov 04 18:50:53 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:53 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-51968a19-3334-4c2d-9a9a-2f60f7002d48 req-a7960404-bf4e-4eac-9823-0cd6ec0c72ea tempest-VolumesSnapshotsTestJSON-431104583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c" returned: 0 in 0.565s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-51968a19-3334-4c2d-9a9a-2f60f7002d48 req-a7960404-bf4e-4eac-9823-0cd6ec0c72ea tempest-VolumesSnapshotsTestJSON-431104583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c.82e2af12-b1f7-428a-840c-65e7cef31672 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:53 devstack sudo[91233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c.82e2af12-b1f7-428a-840c-65e7cef31672 Nov 04 18:50:53 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:53 devstack sudo[91224]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d8632603-f2e3-4e38-88d1-40121b5912ca 1G" returned: 0 in 0.695s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:53 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Downloaded image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d ((None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}])) to volume d8632603-f2e3-4e38-88d1-40121b5912ca successfully. {{(pid=87119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 18:50:53 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Temporary image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d for user 9781f272e19b4fcda6fd614b14fa079e is deleted. {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 18:50:53 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Marking volume d8632603-f2e3-4e38-88d1-40121b5912ca as bootable. {{(pid=87119) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 18:50:53 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Copying metadata from image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d to d8632603-f2e3-4e38-88d1-40121b5912ca. {{(pid=87119) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 18:50:53 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Creating volume glance metadata for volume d8632603-f2e3-4e38-88d1-40121b5912ca backed by image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87119) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 18:50:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e568e2-ba95-4a98-bbae-9d59642b4b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8632603-f2e3-4e38-88d1-40121b5912ca', 'volume_size': 1, 'image_id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '184bff60e125442790f1bc12f0dfbe3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'created_at': datetime.datetime(2026, 11, 4, 17, 42, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:50:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03583002-cdd2-4ddc-9820-dcef88f8719c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:50:53 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Volume volume-d8632603-f2e3-4e38-88d1-40121b5912ca (d8632603-f2e3-4e38-88d1-40121b5912ca): created successfully Nov 04 18:50:54 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03583002-cdd2-4ddc-9820-dcef88f8719c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:50:54 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Flow 'volume_create_manager' (00e109cc-a813-4446-8f3f-9c21f5a7334c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:50:54 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-a301fefd-c729-474a-b50b-a90a2b1b360a tempest-ServerActionsTestOtherA-347787518 None] Created volume successfully. Nov 04 18:50:54 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-51968a19-3334-4c2d-9a9a-2f60f7002d48 req-a7960404-bf4e-4eac-9823-0cd6ec0c72ea tempest-VolumesSnapshotsTestJSON-431104583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c.82e2af12-b1f7-428a-840c-65e7cef31672" returned: 0 in 0.484s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-51968a19-3334-4c2d-9a9a-2f60f7002d48 req-a7960404-bf4e-4eac-9823-0cd6ec0c72ea tempest-VolumesSnapshotsTestJSON-431104583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c.82e2af12-b1f7-428a-840c-65e7cef31672 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:54 devstack sudo[91238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c.82e2af12-b1f7-428a-840c-65e7cef31672 Nov 04 18:50:54 devstack sudo[91238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:54 devstack sudo[91238]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-51968a19-3334-4c2d-9a9a-2f60f7002d48 req-a7960404-bf4e-4eac-9823-0cd6ec0c72ea tempest-VolumesSnapshotsTestJSON-431104583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c.82e2af12-b1f7-428a-840c-65e7cef31672" returned: 0 in 0.319s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:54 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-51968a19-3334-4c2d-9a9a-2f60f7002d48 req-a7960404-bf4e-4eac-9823-0cd6ec0c72ea tempest-VolumesSnapshotsTestJSON-431104583 None] Lock "cinder-quobyte-82e2af12-b1f7-428a-840c-65e7cef31672" released by "_delete_snapshot" :: held 2.088s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:50:54 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-51968a19-3334-4c2d-9a9a-2f60f7002d48 req-a7960404-bf4e-4eac-9823-0cd6ec0c72ea tempest-VolumesSnapshotsTestJSON-431104583 None] Lock "cinder-quobyte-31eaf344-45be-4657-8c46-aed7e4334c8c" released by "delete_snapshot" :: held 2.139s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:50:54 devstack cinder-volume[87119]: WARNING cinder.quota [req-51968a19-3334-4c2d-9a9a-2f60f7002d48 req-a7960404-bf4e-4eac-9823-0cd6ec0c72ea tempest-VolumesSnapshotsTestJSON-431104583 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:50:54 devstack cinder-volume[87119]: DEBUG cinder.quota [req-51968a19-3334-4c2d-9a9a-2f60f7002d48 req-a7960404-bf4e-4eac-9823-0cd6ec0c72ea tempest-VolumesSnapshotsTestJSON-431104583 None] Created reservations ['1c808102-9ff5-4893-ad08-339f7d0f8e94', 'a24a8477-839d-46e6-afdc-1f54cf227add', 'aadcc855-3bbc-43da-b663-0d9a7aa1cf28', '88f1aae0-e51d-4106-b816-15718a4cc33c'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:50:54 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-51968a19-3334-4c2d-9a9a-2f60f7002d48 req-a7960404-bf4e-4eac-9823-0cd6ec0c72ea tempest-VolumesSnapshotsTestJSON-431104583 None] Delete snapshot completed successfully. Nov 04 18:50:54 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-51968a19-3334-4c2d-9a9a-2f60f7002d48 req-a7960404-bf4e-4eac-9823-0cd6ec0c72ea tempest-VolumesSnapshotsTestJSON-431104583 None] Lock "cinder-82e2af12-b1f7-428a-840c-65e7cef31672-delete_snapshot" released by "delete_snapshot" :: held 2.399s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:50:55 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e77c93cc-6336-4b78-9bb7-66deb8510a26 tempest-TaggedAttachmentsTest-1660803797 None] Acquiring lock "cinder-a3cc2f90-3a6b-40ec-9cb0-65d37672e771-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:50:55 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e77c93cc-6336-4b78-9bb7-66deb8510a26 tempest-TaggedAttachmentsTest-1660803797 None] Lock "cinder-a3cc2f90-3a6b-40ec-9cb0-65d37672e771-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:50:55 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e77c93cc-6336-4b78-9bb7-66deb8510a26 tempest-TaggedAttachmentsTest-1660803797 None] Acquiring lock "cinder-quobyte-a3cc2f90-3a6b-40ec-9cb0-65d37672e771" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:50:55 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e77c93cc-6336-4b78-9bb7-66deb8510a26 tempest-TaggedAttachmentsTest-1660803797 None] Lock "cinder-quobyte-a3cc2f90-3a6b-40ec-9cb0-65d37672e771" acquired by "delete_volume" :: waited 0.021s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:50:55 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a590b4e-a56d-4aff-872b-15f36b3f9188]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:50:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e77c93cc-6336-4b78-9bb7-66deb8510a26 tempest-TaggedAttachmentsTest-1660803797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a3cc2f90-3a6b-40ec-9cb0-65d37672e771 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:55 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a3cc2f90-3a6b-40ec-9cb0-65d37672e771 Nov 04 18:50:55 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:55 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-990d6fbc-cbcd-405f-94b7-ecca0c8ba780 req-db7a7db3-eeac-4ebc-b1eb-37276cda2184 tempest-VolumesSnapshotsTestJSON-431104583 None] Acquiring lock "cinder-31eaf344-45be-4657-8c46-aed7e4334c8c-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:50:55 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-990d6fbc-cbcd-405f-94b7-ecca0c8ba780 req-db7a7db3-eeac-4ebc-b1eb-37276cda2184 tempest-VolumesSnapshotsTestJSON-431104583 None] Lock "cinder-31eaf344-45be-4657-8c46-aed7e4334c8c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:50:55 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-990d6fbc-cbcd-405f-94b7-ecca0c8ba780 req-db7a7db3-eeac-4ebc-b1eb-37276cda2184 tempest-VolumesSnapshotsTestJSON-431104583 None] Acquiring lock "cinder-quobyte-31eaf344-45be-4657-8c46-aed7e4334c8c" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:50:56 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-990d6fbc-cbcd-405f-94b7-ecca0c8ba780 req-db7a7db3-eeac-4ebc-b1eb-37276cda2184 tempest-VolumesSnapshotsTestJSON-431104583 None] Lock "cinder-quobyte-31eaf344-45be-4657-8c46-aed7e4334c8c" acquired by "delete_volume" :: waited 0.038s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:50:56 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f73efab-0469-45ec-9830-5436378416b2]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:50:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-990d6fbc-cbcd-405f-94b7-ecca0c8ba780 req-db7a7db3-eeac-4ebc-b1eb-37276cda2184 tempest-VolumesSnapshotsTestJSON-431104583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:56 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e77c93cc-6336-4b78-9bb7-66deb8510a26 tempest-TaggedAttachmentsTest-1660803797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a3cc2f90-3a6b-40ec-9cb0-65d37672e771" returned: 0 in 0.593s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e77c93cc-6336-4b78-9bb7-66deb8510a26 tempest-TaggedAttachmentsTest-1660803797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a3cc2f90-3a6b-40ec-9cb0-65d37672e771 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:56 devstack sudo[91282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a3cc2f90-3a6b-40ec-9cb0-65d37672e771 Nov 04 18:50:56 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:56 devstack sudo[91281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c Nov 04 18:50:56 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:56 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-990d6fbc-cbcd-405f-94b7-ecca0c8ba780 req-db7a7db3-eeac-4ebc-b1eb-37276cda2184 tempest-VolumesSnapshotsTestJSON-431104583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c" returned: 0 in 0.519s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:56 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-990d6fbc-cbcd-405f-94b7-ecca0c8ba780 req-db7a7db3-eeac-4ebc-b1eb-37276cda2184 tempest-VolumesSnapshotsTestJSON-431104583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e77c93cc-6336-4b78-9bb7-66deb8510a26 tempest-TaggedAttachmentsTest-1660803797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a3cc2f90-3a6b-40ec-9cb0-65d37672e771" returned: 0 in 0.508s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:56 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e77c93cc-6336-4b78-9bb7-66deb8510a26 tempest-TaggedAttachmentsTest-1660803797 None] Lock "cinder-quobyte-a3cc2f90-3a6b-40ec-9cb0-65d37672e771" released by "delete_volume" :: held 1.167s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:50:56 devstack sudo[91293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c Nov 04 18:50:56 devstack sudo[91293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:56 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-e77c93cc-6336-4b78-9bb7-66deb8510a26 tempest-TaggedAttachmentsTest-1660803797 None] Created reservations ['24077f9d-224d-4077-9d24-7f3e059e2545', '522b3a94-b082-4cec-a61b-ba9e39040d69', 'f59b3bc6-96b7-47b0-86ef-014717452d43', '82b7c591-eee8-4665-bd35-4be880986e9e'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:50:56 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-bec4842f-7df8-46f0-8b28-9af43eeaa68f tempest-ServerRescueNegativeTestJSON-1564823756 None] Acquiring lock "cinder-c0a0c899-0291-49fb-87a0-7be14b45e170-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:50:56 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-bec4842f-7df8-46f0-8b28-9af43eeaa68f tempest-ServerRescueNegativeTestJSON-1564823756 None] Lock "cinder-c0a0c899-0291-49fb-87a0-7be14b45e170-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:50:56 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-bec4842f-7df8-46f0-8b28-9af43eeaa68f tempest-ServerRescueNegativeTestJSON-1564823756 None] Acquiring lock "cinder-quobyte-c0a0c899-0291-49fb-87a0-7be14b45e170" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:50:56 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-bec4842f-7df8-46f0-8b28-9af43eeaa68f tempest-ServerRescueNegativeTestJSON-1564823756 None] Lock "cinder-quobyte-c0a0c899-0291-49fb-87a0-7be14b45e170" acquired by "delete_volume" :: waited 0.042s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:50:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e77c93cc-6336-4b78-9bb7-66deb8510a26 tempest-TaggedAttachmentsTest-1660803797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:50:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e77c93cc-6336-4b78-9bb7-66deb8510a26 tempest-TaggedAttachmentsTest-1660803797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:50:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e77c93cc-6336-4b78-9bb7-66deb8510a26 tempest-TaggedAttachmentsTest-1660803797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:50:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e77c93cc-6336-4b78-9bb7-66deb8510a26 tempest-TaggedAttachmentsTest-1660803797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:50:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e77c93cc-6336-4b78-9bb7-66deb8510a26 tempest-TaggedAttachmentsTest-1660803797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:50:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e77c93cc-6336-4b78-9bb7-66deb8510a26 tempest-TaggedAttachmentsTest-1660803797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:57 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f510f6d9-3a04-4d7e-94ab-76e78a09f82c]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:50:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bec4842f-7df8-46f0-8b28-9af43eeaa68f tempest-ServerRescueNegativeTestJSON-1564823756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c0a0c899-0291-49fb-87a0-7be14b45e170 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:57 devstack sudo[91295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:50:57 devstack sudo[91295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:57 devstack sudo[91293]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-990d6fbc-cbcd-405f-94b7-ecca0c8ba780 req-db7a7db3-eeac-4ebc-b1eb-37276cda2184 tempest-VolumesSnapshotsTestJSON-431104583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-31eaf344-45be-4657-8c46-aed7e4334c8c" returned: 0 in 0.543s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:57 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-990d6fbc-cbcd-405f-94b7-ecca0c8ba780 req-db7a7db3-eeac-4ebc-b1eb-37276cda2184 tempest-VolumesSnapshotsTestJSON-431104583 None] Lock "cinder-quobyte-31eaf344-45be-4657-8c46-aed7e4334c8c" released by "delete_volume" :: held 1.213s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:50:57 devstack sudo[91296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c0a0c899-0291-49fb-87a0-7be14b45e170 Nov 04 18:50:57 devstack sudo[91296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:57 devstack cinder-volume[87119]: DEBUG cinder.quota [req-990d6fbc-cbcd-405f-94b7-ecca0c8ba780 req-db7a7db3-eeac-4ebc-b1eb-37276cda2184 tempest-VolumesSnapshotsTestJSON-431104583 None] Created reservations ['6d200547-5c00-4cae-be4d-626a2b89fc74', '8a7009dc-0749-4359-a9fd-10e1ac29ee1b', 'd17e92ff-3079-4785-8978-485b8c18eb51', '02291c98-9aab-4588-909c-a7841f144679'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:50:57 devstack sudo[91295]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e77c93cc-6336-4b78-9bb7-66deb8510a26 tempest-TaggedAttachmentsTest-1660803797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.458s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:57 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-e77c93cc-6336-4b78-9bb7-66deb8510a26 tempest-TaggedAttachmentsTest-1660803797 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:50:57 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e77c93cc-6336-4b78-9bb7-66deb8510a26 tempest-TaggedAttachmentsTest-1660803797 None] Deleted volume successfully. Nov 04 18:50:57 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e77c93cc-6336-4b78-9bb7-66deb8510a26 tempest-TaggedAttachmentsTest-1660803797 None] Lock "cinder-a3cc2f90-3a6b-40ec-9cb0-65d37672e771-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:50:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-990d6fbc-cbcd-405f-94b7-ecca0c8ba780 req-db7a7db3-eeac-4ebc-b1eb-37276cda2184 tempest-VolumesSnapshotsTestJSON-431104583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:50:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-990d6fbc-cbcd-405f-94b7-ecca0c8ba780 req-db7a7db3-eeac-4ebc-b1eb-37276cda2184 tempest-VolumesSnapshotsTestJSON-431104583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:50:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [req-990d6fbc-cbcd-405f-94b7-ecca0c8ba780 req-db7a7db3-eeac-4ebc-b1eb-37276cda2184 tempest-VolumesSnapshotsTestJSON-431104583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:50:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [req-990d6fbc-cbcd-405f-94b7-ecca0c8ba780 req-db7a7db3-eeac-4ebc-b1eb-37276cda2184 tempest-VolumesSnapshotsTestJSON-431104583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:50:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-990d6fbc-cbcd-405f-94b7-ecca0c8ba780 req-db7a7db3-eeac-4ebc-b1eb-37276cda2184 tempest-VolumesSnapshotsTestJSON-431104583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:50:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-990d6fbc-cbcd-405f-94b7-ecca0c8ba780 req-db7a7db3-eeac-4ebc-b1eb-37276cda2184 tempest-VolumesSnapshotsTestJSON-431104583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:57 devstack sudo[91301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:50:57 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:57 devstack sudo[91296]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bec4842f-7df8-46f0-8b28-9af43eeaa68f tempest-ServerRescueNegativeTestJSON-1564823756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c0a0c899-0291-49fb-87a0-7be14b45e170" returned: 0 in 0.768s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bec4842f-7df8-46f0-8b28-9af43eeaa68f tempest-ServerRescueNegativeTestJSON-1564823756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c0a0c899-0291-49fb-87a0-7be14b45e170 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:57 devstack sudo[91308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c0a0c899-0291-49fb-87a0-7be14b45e170 Nov 04 18:50:57 devstack sudo[91308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:58 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-990d6fbc-cbcd-405f-94b7-ecca0c8ba780 req-db7a7db3-eeac-4ebc-b1eb-37276cda2184 tempest-VolumesSnapshotsTestJSON-431104583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.748s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:58 devstack cinder-volume[87119]: DEBUG cinder.manager [req-990d6fbc-cbcd-405f-94b7-ecca0c8ba780 req-db7a7db3-eeac-4ebc-b1eb-37276cda2184 tempest-VolumesSnapshotsTestJSON-431104583 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:50:58 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-990d6fbc-cbcd-405f-94b7-ecca0c8ba780 req-db7a7db3-eeac-4ebc-b1eb-37276cda2184 tempest-VolumesSnapshotsTestJSON-431104583 None] Deleted volume successfully. Nov 04 18:50:58 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-990d6fbc-cbcd-405f-94b7-ecca0c8ba780 req-db7a7db3-eeac-4ebc-b1eb-37276cda2184 tempest-VolumesSnapshotsTestJSON-431104583 None] Lock "cinder-31eaf344-45be-4657-8c46-aed7e4334c8c-delete_volume" released by "delete_volume" :: held 2.587s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:50:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-14001c94-9644-4039-b16e-151170eebd69 req-3b4dd1f2-6be5-4571-a043-bdf076b2029a tempest-ServerActionsTestOtherA-347787518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:50:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-14001c94-9644-4039-b16e-151170eebd69 req-3b4dd1f2-6be5-4571-a043-bdf076b2029a tempest-ServerActionsTestOtherA-347787518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:50:58 devstack sudo[91308]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bec4842f-7df8-46f0-8b28-9af43eeaa68f tempest-ServerRescueNegativeTestJSON-1564823756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c0a0c899-0291-49fb-87a0-7be14b45e170" returned: 0 in 0.951s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-14001c94-9644-4039-b16e-151170eebd69 req-3b4dd1f2-6be5-4571-a043-bdf076b2029a tempest-ServerActionsTestOtherA-347787518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.074s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:50:58 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-bec4842f-7df8-46f0-8b28-9af43eeaa68f tempest-ServerRescueNegativeTestJSON-1564823756 None] Lock "cinder-quobyte-c0a0c899-0291-49fb-87a0-7be14b45e170" released by "delete_volume" :: held 1.894s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:50:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-14001c94-9644-4039-b16e-151170eebd69 req-3b4dd1f2-6be5-4571-a043-bdf076b2029a tempest-ServerActionsTestOtherA-347787518 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280', 'name': 'volume-d8632603-f2e3-4e38-88d1-40121b5912ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '39d1efc6-7e64-4806-bbaa-3c952e7c7007', 'enforce_multipath': True} {{(pid=87119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:50:59 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-bec4842f-7df8-46f0-8b28-9af43eeaa68f tempest-ServerRescueNegativeTestJSON-1564823756 None] Created reservations ['aadd385d-d66d-46ad-ba63-fc514183044d', 'e370c434-7d02-4fa0-8bd0-ceeb123ddb66', 'd8bf0475-d0c5-4d29-b94b-d2b9c702c5ed', '199bf442-6699-4441-8672-6ddbec8cdc19'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:50:59 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-14001c94-9644-4039-b16e-151170eebd69 req-3b4dd1f2-6be5-4571-a043-bdf076b2029a tempest-ServerActionsTestOtherA-347787518 None] attachment_update completed successfully. Nov 04 18:50:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bec4842f-7df8-46f0-8b28-9af43eeaa68f tempest-ServerRescueNegativeTestJSON-1564823756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:50:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bec4842f-7df8-46f0-8b28-9af43eeaa68f tempest-ServerRescueNegativeTestJSON-1564823756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:50:59 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bec4842f-7df8-46f0-8b28-9af43eeaa68f tempest-ServerRescueNegativeTestJSON-1564823756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:50:59 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bec4842f-7df8-46f0-8b28-9af43eeaa68f tempest-ServerRescueNegativeTestJSON-1564823756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:50:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bec4842f-7df8-46f0-8b28-9af43eeaa68f tempest-ServerRescueNegativeTestJSON-1564823756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:50:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bec4842f-7df8-46f0-8b28-9af43eeaa68f tempest-ServerRescueNegativeTestJSON-1564823756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:59 devstack sudo[91320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:50:59 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:50:59 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root Nov 04 18:50:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bec4842f-7df8-46f0-8b28-9af43eeaa68f tempest-ServerRescueNegativeTestJSON-1564823756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.604s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:50:59 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-bec4842f-7df8-46f0-8b28-9af43eeaa68f tempest-ServerRescueNegativeTestJSON-1564823756 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:50:59 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-bec4842f-7df8-46f0-8b28-9af43eeaa68f tempest-ServerRescueNegativeTestJSON-1564823756 None] Deleted volume successfully. Nov 04 18:51:00 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-bec4842f-7df8-46f0-8b28-9af43eeaa68f tempest-ServerRescueNegativeTestJSON-1564823756 None] Lock "cinder-c0a0c899-0291-49fb-87a0-7be14b45e170-delete_volume" released by "delete_volume" :: held 3.189s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:51:07 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:51:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Flow 'volume_create_manager' (facc9e48-7246-40ea-b414-88e0a461fab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:51:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faddef40-092d-4639-aacf-32763cded4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faddef40-092d-4639-aacf-32763cded4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-750741943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e38acbb5-5d61-4db5-bd85-94601f568f17,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c41f3ca4b04428db5b3a99ebc856bc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:51:07Z,use_quota=True,user_id='a7faf445c7d64d829cd7487bac4bfcca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa2e08c-24eb-414b-a7b3-6ae8d18979d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa2e08c-24eb-414b-a7b3-6ae8d18979d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab8c7a6f-5b99-4a8a-b1d4-52de052ff0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab8c7a6f-5b99-4a8a-b1d4-52de052ff0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e38acbb5-5d61-4db5-bd85-94601f568f17', 'volume_name': 'volume-e38acbb5-5d61-4db5-bd85-94601f568f17', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ec857d-73f7-49ae-8462-ab506225bac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ec857d-73f7-49ae-8462-ab506225bac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91697477-b718-4465-bab2-7fe76ed85a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:07 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Volume e38acbb5-5d61-4db5-bd85-94601f568f17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e38acbb5-5d61-4db5-bd85-94601f568f17', 'volume_size': 1} Nov 04 18:51:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-750741943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e38acbb5-5d61-4db5-bd85-94601f568f17,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c41f3ca4b04428db5b3a99ebc856bc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:51:07Z,use_quota=True,user_id='a7faf445c7d64d829cd7487bac4bfcca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:51:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Creating volume e38acbb5-5d61-4db5-bd85-94601f568f17 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:51:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:51:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:51:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:51:07 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:51:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e38acbb5-5d61-4db5-bd85-94601f568f17 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:07 devstack sudo[91846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e38acbb5-5d61-4db5-bd85-94601f568f17 1073741824 Nov 04 18:51:07 devstack sudo[91846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:08 devstack sudo[91846]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e38acbb5-5d61-4db5-bd85-94601f568f17 1073741824" returned: 0 in 0.828s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e38acbb5-5d61-4db5-bd85-94601f568f17 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:08 devstack sudo[91855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e38acbb5-5d61-4db5-bd85-94601f568f17 Nov 04 18:51:08 devstack sudo[91855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:09 devstack sudo[91855]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e38acbb5-5d61-4db5-bd85-94601f568f17" returned: 0 in 0.496s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:51:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91697477-b718-4465-bab2-7fe76ed85a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e38acbb5-5d61-4db5-bd85-94601f568f17', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2cd7461-8ce0-46be-8729-9899074549fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:09 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Volume volume-e38acbb5-5d61-4db5-bd85-94601f568f17 (e38acbb5-5d61-4db5-bd85-94601f568f17): created successfully Nov 04 18:51:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2cd7461-8ce0-46be-8729-9899074549fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Flow 'volume_create_manager' (facc9e48-7246-40ea-b414-88e0a461fab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:51:09 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-bd9a64d2-5c4e-4147-adff-52a524ea7e4b req-cdbdf6a8-9924-49e2-9b0e-70425c4bb1fb tempest-VolumesGetTestJSON-1113494462 None] Created volume successfully. Nov 04 18:51:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-132ac1a7-6bca-4ea5-9eda-95b9d0bba191 req-0d97a94d-0c58-4c7c-a55e-aef3e7305d7e tempest-VolumesGetTestJSON-1113494462 None] Acquiring lock "cinder-e38acbb5-5d61-4db5-bd85-94601f568f17-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:51:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-132ac1a7-6bca-4ea5-9eda-95b9d0bba191 req-0d97a94d-0c58-4c7c-a55e-aef3e7305d7e tempest-VolumesGetTestJSON-1113494462 None] Lock "cinder-e38acbb5-5d61-4db5-bd85-94601f568f17-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:51:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-132ac1a7-6bca-4ea5-9eda-95b9d0bba191 req-0d97a94d-0c58-4c7c-a55e-aef3e7305d7e tempest-VolumesGetTestJSON-1113494462 None] Acquiring lock "cinder-quobyte-e38acbb5-5d61-4db5-bd85-94601f568f17" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:51:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-132ac1a7-6bca-4ea5-9eda-95b9d0bba191 req-0d97a94d-0c58-4c7c-a55e-aef3e7305d7e tempest-VolumesGetTestJSON-1113494462 None] Lock "cinder-quobyte-e38acbb5-5d61-4db5-bd85-94601f568f17" acquired by "delete_volume" :: waited 0.040s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:51:10 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d84b90-0643-4fe3-a7cc-846954c6a912]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:51:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-132ac1a7-6bca-4ea5-9eda-95b9d0bba191 req-0d97a94d-0c58-4c7c-a55e-aef3e7305d7e tempest-VolumesGetTestJSON-1113494462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e38acbb5-5d61-4db5-bd85-94601f568f17 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:11 devstack sudo[91864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e38acbb5-5d61-4db5-bd85-94601f568f17 Nov 04 18:51:11 devstack sudo[91864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:11 devstack sudo[91864]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-132ac1a7-6bca-4ea5-9eda-95b9d0bba191 req-0d97a94d-0c58-4c7c-a55e-aef3e7305d7e tempest-VolumesGetTestJSON-1113494462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e38acbb5-5d61-4db5-bd85-94601f568f17" returned: 0 in 0.633s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-132ac1a7-6bca-4ea5-9eda-95b9d0bba191 req-0d97a94d-0c58-4c7c-a55e-aef3e7305d7e tempest-VolumesGetTestJSON-1113494462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e38acbb5-5d61-4db5-bd85-94601f568f17 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:11 devstack sudo[91869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e38acbb5-5d61-4db5-bd85-94601f568f17 Nov 04 18:51:11 devstack sudo[91869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:11 devstack sudo[91869]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-132ac1a7-6bca-4ea5-9eda-95b9d0bba191 req-0d97a94d-0c58-4c7c-a55e-aef3e7305d7e tempest-VolumesGetTestJSON-1113494462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e38acbb5-5d61-4db5-bd85-94601f568f17" returned: 0 in 0.341s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:11 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-132ac1a7-6bca-4ea5-9eda-95b9d0bba191 req-0d97a94d-0c58-4c7c-a55e-aef3e7305d7e tempest-VolumesGetTestJSON-1113494462 None] Lock "cinder-quobyte-e38acbb5-5d61-4db5-bd85-94601f568f17" released by "delete_volume" :: held 1.047s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:51:11 devstack cinder-volume[87119]: DEBUG cinder.quota [req-132ac1a7-6bca-4ea5-9eda-95b9d0bba191 req-0d97a94d-0c58-4c7c-a55e-aef3e7305d7e tempest-VolumesGetTestJSON-1113494462 None] Created reservations ['4835662f-ccf9-48d1-a527-99db55ff2e75', 'b3b246c9-2929-4e81-a3f4-a87bb56c68d3', '7be0fef3-9008-48bf-917b-68c392d10c4e', '25301a21-740c-4fa0-80bb-f46f8792ddd1'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:51:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-132ac1a7-6bca-4ea5-9eda-95b9d0bba191 req-0d97a94d-0c58-4c7c-a55e-aef3e7305d7e tempest-VolumesGetTestJSON-1113494462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-132ac1a7-6bca-4ea5-9eda-95b9d0bba191 req-0d97a94d-0c58-4c7c-a55e-aef3e7305d7e tempest-VolumesGetTestJSON-1113494462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:12 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [req-132ac1a7-6bca-4ea5-9eda-95b9d0bba191 req-0d97a94d-0c58-4c7c-a55e-aef3e7305d7e tempest-VolumesGetTestJSON-1113494462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:51:12 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [req-132ac1a7-6bca-4ea5-9eda-95b9d0bba191 req-0d97a94d-0c58-4c7c-a55e-aef3e7305d7e tempest-VolumesGetTestJSON-1113494462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:51:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-132ac1a7-6bca-4ea5-9eda-95b9d0bba191 req-0d97a94d-0c58-4c7c-a55e-aef3e7305d7e tempest-VolumesGetTestJSON-1113494462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-132ac1a7-6bca-4ea5-9eda-95b9d0bba191 req-0d97a94d-0c58-4c7c-a55e-aef3e7305d7e tempest-VolumesGetTestJSON-1113494462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:12 devstack sudo[91872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:51:12 devstack sudo[91872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:12 devstack sudo[91872]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-132ac1a7-6bca-4ea5-9eda-95b9d0bba191 req-0d97a94d-0c58-4c7c-a55e-aef3e7305d7e tempest-VolumesGetTestJSON-1113494462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.418s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:12 devstack cinder-volume[87119]: DEBUG cinder.manager [req-132ac1a7-6bca-4ea5-9eda-95b9d0bba191 req-0d97a94d-0c58-4c7c-a55e-aef3e7305d7e tempest-VolumesGetTestJSON-1113494462 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:51:12 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-132ac1a7-6bca-4ea5-9eda-95b9d0bba191 req-0d97a94d-0c58-4c7c-a55e-aef3e7305d7e tempest-VolumesGetTestJSON-1113494462 None] Deleted volume successfully. Nov 04 18:51:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-132ac1a7-6bca-4ea5-9eda-95b9d0bba191 req-0d97a94d-0c58-4c7c-a55e-aef3e7305d7e tempest-VolumesGetTestJSON-1113494462 None] Lock "cinder-e38acbb5-5d61-4db5-bd85-94601f568f17-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:51:22 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:UPDATE=59,cinder:SELECT=65,cinder:INSERT=18,cinder:DELETE=2 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:51:22 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=65,cinder:INSERT=24,cinder:UPDATE=69,cinder:DELETE=8 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:51:22 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-ce0aad8d-4a10-4b72-9563-aa1a38ecb6d7 req-4cf64dd5-c69e-4f84-a8b3-df64ab69f378 tempest-ServerActionsTestOtherA-347787518 None] Terminate volume connection completed successfully. Nov 04 18:51:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-ce0aad8d-4a10-4b72-9563-aa1a38ecb6d7 req-4cf64dd5-c69e-4f84-a8b3-df64ab69f378 tempest-ServerActionsTestOtherA-347787518 None] Deleting attachment 39d1efc6-7e64-4806-bbaa-3c952e7c7007. {{(pid=87119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:51:24 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-15ed5ea8-d9b3-47f7-b10a-60e785f3a1e8 tempest-BackendsCapabilitiesAdminTestsJSON-1705281930 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5831718444824, 'free_capacity_gb': 1773.5831718444824, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87119) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 04 18:51:24 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-367c95e8-6069-4505-909f-9aac2ea12896 tempest-BackendsCapabilitiesAdminTestsJSON-1705281930 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5831718444824, 'free_capacity_gb': 1773.5831718444824, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87119) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 04 18:51:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:51:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:51:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:51:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:25 devstack sudo[91949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:51:25 devstack sudo[91949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-ce0aad8d-4a10-4b72-9563-aa1a38ecb6d7 req-0a0ab13b-60c5-4d58-aeb6-13c46c80576a tempest-ServerActionsTestOtherA-347787518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-ce0aad8d-4a10-4b72-9563-aa1a38ecb6d7 req-0a0ab13b-60c5-4d58-aeb6-13c46c80576a tempest-ServerActionsTestOtherA-347787518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-ce0aad8d-4a10-4b72-9563-aa1a38ecb6d7 req-0a0ab13b-60c5-4d58-aeb6-13c46c80576a tempest-ServerActionsTestOtherA-347787518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-ce0aad8d-4a10-4b72-9563-aa1a38ecb6d7 req-0a0ab13b-60c5-4d58-aeb6-13c46c80576a tempest-ServerActionsTestOtherA-347787518 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280', 'name': 'volume-d8632603-f2e3-4e38-88d1-40121b5912ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6e3ed07a-2e2f-48a4-b2e6-a1cfc62eb579', 'enforce_multipath': True} {{(pid=87119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:51:25 devstack sudo[91949]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.391s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:25 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:51:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager._thread_info {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:51:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread count: 28 {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:51:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread info: [<_MainThread(MainThread, started 130247852032128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:51:25 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-ce0aad8d-4a10-4b72-9563-aa1a38ecb6d7 req-0a0ab13b-60c5-4d58-aeb6-13c46c80576a tempest-ServerActionsTestOtherA-347787518 None] attachment_update completed successfully. Nov 04 18:51:35 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:51:35 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:51:38 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-ce076c81-32e1-4ffd-b371-681b3ab7478f tempest-GroupsTest-682968728 None] Group tempest-Group1-1223071632: creating Nov 04 18:51:38 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-ce076c81-32e1-4ffd-b371-681b3ab7478f tempest-GroupsTest-682968728 None] Group tempest-Group1-1223071632: created successfully Nov 04 18:51:38 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-ce076c81-32e1-4ffd-b371-681b3ab7478f tempest-GroupsTest-682968728 None] Create group completed successfully. Nov 04 18:51:38 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-a3305d6c-fa48-42fd-a99d-5f339f014412 tempest-GroupSnapshotsTest-1933020210 None] Group tempest-GroupSnapshotsTest-Group-1593631299: creating Nov 04 18:51:38 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-a3305d6c-fa48-42fd-a99d-5f339f014412 tempest-GroupSnapshotsTest-1933020210 None] Group tempest-GroupSnapshotsTest-Group-1593631299: created successfully Nov 04 18:51:38 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-a3305d6c-fa48-42fd-a99d-5f339f014412 tempest-GroupSnapshotsTest-1933020210 None] Create group completed successfully. Nov 04 18:51:39 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-b56f8d7d-79ee-4db9-95a6-94cc6608ab97 tempest-GroupsTest-682968728 None] Group tempest-Group2-1708439330: creating Nov 04 18:51:39 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-b56f8d7d-79ee-4db9-95a6-94cc6608ab97 tempest-GroupsTest-682968728 None] Group tempest-Group2-1708439330: created successfully Nov 04 18:51:39 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-b56f8d7d-79ee-4db9-95a6-94cc6608ab97 tempest-GroupsTest-682968728 None] Create group completed successfully. Nov 04 18:51:40 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:51:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Flow 'volume_create_manager' (3165d75c-f4a8-4ee1-9a88-7dc8a4df814d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:51:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22d57973-5e89-4a9f-997a-931557732cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22d57973-5e89-4a9f-997a-931557732cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1865202968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=363bff70-e7d4-4171-85ff-3ad43fd21f89,host='devstack@QuobyteHD#QuobyteHD',id=6d7e3566-329c-4ab8-b911-efb417b4cdf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68623afa0c214601bdec4e8e175718dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:51:40Z,use_quota=True,user_id='99a5e0cbf21448169b721faeea4317f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(331b8819-3ced-44e4-a15a-1d6cf5531a7b),volume_type_id=331b8819-3ced-44e4-a15a-1d6cf5531a7b)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3ce35f-bf98-4e4a-a4f5-9fae757ce8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3ce35f-bf98-4e4a-a4f5-9fae757ce8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50f0639-09f7-472e-94f1-9b43e1ac1386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50f0639-09f7-472e-94f1-9b43e1ac1386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d7e3566-329c-4ab8-b911-efb417b4cdf8', 'volume_name': 'volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb1f302-7bf0-4f39-b272-f77f829a1751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb1f302-7bf0-4f39-b272-f77f829a1751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77311d0a-752f-448d-8b21-f4e96e39ca6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:40 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Volume 6d7e3566-329c-4ab8-b911-efb417b4cdf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8', 'volume_size': 1} Nov 04 18:51:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:40 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=363bff70-e7d4-4171-85ff-3ad43fd21f89,created_at=2026-11-04T17:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1865202968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=363bff70-e7d4-4171-85ff-3ad43fd21f89,host='devstack@QuobyteHD#QuobyteHD',id=6d7e3566-329c-4ab8-b911-efb417b4cdf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68623afa0c214601bdec4e8e175718dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:51:40Z,use_quota=True,user_id='99a5e0cbf21448169b721faeea4317f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(331b8819-3ced-44e4-a15a-1d6cf5531a7b),volume_type_id=331b8819-3ced-44e4-a15a-1d6cf5531a7b)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:51:40 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Creating volume 6d7e3566-329c-4ab8-b911-efb417b4cdf8 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:51:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:40 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:51:40 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:51:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:40 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:51:40 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:51:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:40 devstack sudo[92435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8 1073741824 Nov 04 18:51:40 devstack sudo[92435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:40 devstack sudo[92435]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8 1073741824" returned: 0 in 0.743s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:41 devstack sudo[92473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8 Nov 04 18:51:41 devstack sudo[92473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:41 devstack sudo[92473]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Flow 'volume_create_manager' (fab6541f-ba95-4127-a5a8-7389f252f0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ce20f6-549e-4ffc-b432-32ac1c6b4009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8" returned: 0 in 0.664s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ce20f6-549e-4ffc-b432-32ac1c6b4009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1703184499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=688d4245-e310-4d73-a43c-f41d81952c89,host='devstack@QuobyteHD#QuobyteHD',id=b7bc5ff5-0bc8-423e-b5e5-65f4c48923f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e35de31ccf41483e8e8729e15cf1955d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:51:42Z,use_quota=True,user_id='bb8e6618a659480db5137660b94835bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c30955e-bd28-4ce4-9c52-234e3a717ddf),volume_type_id=6c30955e-bd28-4ce4-9c52-234e3a717ddf)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (748d85f0-d292-4260-a613-34b5ef0c642c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (748d85f0-d292-4260-a613-34b5ef0c642c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aebc149e-2bb9-4020-9720-64037f2af4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aebc149e-2bb9-4020-9720-64037f2af4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7bc5ff5-0bc8-423e-b5e5-65f4c48923f8', 'volume_name': 'volume-b7bc5ff5-0bc8-423e-b5e5-65f4c48923f8', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b68ae43-9c5f-4a41-9776-ff635e053492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b68ae43-9c5f-4a41-9776-ff635e053492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc11fdc8-0eb8-453d-ae3e-9731501f3044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:41 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Volume b7bc5ff5-0bc8-423e-b5e5-65f4c48923f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7bc5ff5-0bc8-423e-b5e5-65f4c48923f8', 'volume_size': 1} Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=688d4245-e310-4d73-a43c-f41d81952c89,created_at=2026-11-04T17:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1703184499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=688d4245-e310-4d73-a43c-f41d81952c89,host='devstack@QuobyteHD#QuobyteHD',id=b7bc5ff5-0bc8-423e-b5e5-65f4c48923f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e35de31ccf41483e8e8729e15cf1955d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:51:42Z,use_quota=True,user_id='bb8e6618a659480db5137660b94835bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c30955e-bd28-4ce4-9c52-234e3a717ddf),volume_type_id=6c30955e-bd28-4ce4-9c52-234e3a717ddf)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Creating volume b7bc5ff5-0bc8-423e-b5e5-65f4c48923f8 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:51:41 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b7bc5ff5-0bc8-423e-b5e5-65f4c48923f8 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77311d0a-752f-448d-8b21-f4e96e39ca6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e28c99a-3719-4630-a384-0b7aca9ffcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:41 devstack sudo[92486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b7bc5ff5-0bc8-423e-b5e5-65f4c48923f8 1073741824 Nov 04 18:51:41 devstack sudo[92486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:41 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Volume volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8 (6d7e3566-329c-4ab8-b911-efb417b4cdf8): created successfully Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e28c99a-3719-4630-a384-0b7aca9ffcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:41 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Flow 'volume_create_manager' (3165d75c-f4a8-4ee1-9a88-7dc8a4df814d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:51:41 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-c7b8ea0d-68e7-41ef-b939-56eaf154603f tempest-GroupSnapshotsTest-1933020210 None] Created volume successfully. Nov 04 18:51:42 devstack sudo[92486]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b7bc5ff5-0bc8-423e-b5e5-65f4c48923f8 1073741824" returned: 0 in 0.577s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b7bc5ff5-0bc8-423e-b5e5-65f4c48923f8 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:42 devstack sudo[92497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b7bc5ff5-0bc8-423e-b5e5-65f4c48923f8 Nov 04 18:51:42 devstack sudo[92497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:42 devstack sudo[92497]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b7bc5ff5-0bc8-423e-b5e5-65f4c48923f8" returned: 0 in 0.274s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:42 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:51:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc11fdc8-0eb8-453d-ae3e-9731501f3044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7bc5ff5-0bc8-423e-b5e5-65f4c48923f8', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9eb4399-8392-453e-9965-083edaf50382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:42 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Volume volume-b7bc5ff5-0bc8-423e-b5e5-65f4c48923f8 (b7bc5ff5-0bc8-423e-b5e5-65f4c48923f8): created successfully Nov 04 18:51:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9eb4399-8392-453e-9965-083edaf50382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Flow 'volume_create_manager' (fab6541f-ba95-4127-a5a8-7389f252f0e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:51:42 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-846cb614-ab7f-4c8d-b452-655e1e467f54 tempest-GroupsTest-682968728 None] Created volume successfully. Nov 04 18:51:43 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-b0e4b92a-96be-4c33-a6cb-71a5ffc34cdb tempest-GroupSnapshotsTest-1933020210 None] GroupSnapshot 43717ad9-ce9a-423b-a4cc-86b8e802c447: creating. Nov 04 18:51:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b0e4b92a-96be-4c33-a6cb-71a5ffc34cdb tempest-GroupSnapshotsTest-1933020210 None] Group snapshot 43717ad9-ce9a-423b-a4cc-86b8e802c447: creating. {{(pid=87119) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 04 18:51:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b0e4b92a-96be-4c33-a6cb-71a5ffc34cdb tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b0e4b92a-96be-4c33-a6cb-71a5ffc34cdb tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:43 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-b0e4b92a-96be-4c33-a6cb-71a5ffc34cdb tempest-GroupSnapshotsTest-1933020210 None] Creating offline snapshot 5dc6e752-e000-4d3e-922b-b072c6f447d2 of volume 6d7e3566-329c-4ab8-b911-efb417b4cdf8 {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:51:43 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa6a474-d0ed-47ed-b368-fa08f6d281ca]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:51:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b0e4b92a-96be-4c33-a6cb-71a5ffc34cdb tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:43 devstack sudo[92500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8 Nov 04 18:51:43 devstack sudo[92500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:44 devstack sudo[92500]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b0e4b92a-96be-4c33-a6cb-71a5ffc34cdb tempest-GroupSnapshotsTest-1933020210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8" returned: 0 in 0.663s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b0e4b92a-96be-4c33-a6cb-71a5ffc34cdb tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.5dc6e752-e000-4d3e-922b-b072c6f447d2 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5f9e1f39-a31a-4ffc-8f23-b789d95c04d4 tempest-GroupsTest-682968728 None] Acquiring lock "cinder-quobyte-b7bc5ff5-0bc8-423e-b5e5-65f4c48923f8" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:51:44 devstack sudo[92507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.5dc6e752-e000-4d3e-922b-b072c6f447d2 1G Nov 04 18:51:44 devstack sudo[92507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5f9e1f39-a31a-4ffc-8f23-b789d95c04d4 tempest-GroupsTest-682968728 None] Lock "cinder-quobyte-b7bc5ff5-0bc8-423e-b5e5-65f4c48923f8" acquired by "delete_volume" :: waited 0.018s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:51:44 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e072fb99-d458-4046-9d49-974aa666c0dc]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:51:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5f9e1f39-a31a-4ffc-8f23-b789d95c04d4 tempest-GroupsTest-682968728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b7bc5ff5-0bc8-423e-b5e5-65f4c48923f8 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:44 devstack sudo[92509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b7bc5ff5-0bc8-423e-b5e5-65f4c48923f8 Nov 04 18:51:44 devstack sudo[92509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5f9e1f39-a31a-4ffc-8f23-b789d95c04d4 tempest-GroupsTest-682968728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b7bc5ff5-0bc8-423e-b5e5-65f4c48923f8" returned: 0 in 0.574s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5f9e1f39-a31a-4ffc-8f23-b789d95c04d4 tempest-GroupsTest-682968728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b7bc5ff5-0bc8-423e-b5e5-65f4c48923f8 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:44 devstack sudo[92509]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:44 devstack sudo[92507]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b0e4b92a-96be-4c33-a6cb-71a5ffc34cdb tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.5dc6e752-e000-4d3e-922b-b072c6f447d2 1G" returned: 0 in 0.711s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b0e4b92a-96be-4c33-a6cb-71a5ffc34cdb tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.5dc6e752-e000-4d3e-922b-b072c6f447d2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:44 devstack sudo[92522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b7bc5ff5-0bc8-423e-b5e5-65f4c48923f8 Nov 04 18:51:44 devstack sudo[92522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:44 devstack sudo[92526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.5dc6e752-e000-4d3e-922b-b072c6f447d2 Nov 04 18:51:44 devstack sudo[92526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:45 devstack sudo[92526]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b0e4b92a-96be-4c33-a6cb-71a5ffc34cdb tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.5dc6e752-e000-4d3e-922b-b072c6f447d2" returned: 0 in 0.691s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:45 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-b0e4b92a-96be-4c33-a6cb-71a5ffc34cdb tempest-GroupSnapshotsTest-1933020210 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.5dc6e752-e000-4d3e-922b-b072c6f447d2 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 18:51:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b0e4b92a-96be-4c33-a6cb-71a5ffc34cdb tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.5dc6e752-e000-4d3e-922b-b072c6f447d2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:45 devstack sudo[92522]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5f9e1f39-a31a-4ffc-8f23-b789d95c04d4 tempest-GroupsTest-682968728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b7bc5ff5-0bc8-423e-b5e5-65f4c48923f8" returned: 0 in 0.764s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:45 devstack sudo[92577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.5dc6e752-e000-4d3e-922b-b072c6f447d2 Nov 04 18:51:45 devstack sudo[92577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5f9e1f39-a31a-4ffc-8f23-b789d95c04d4 tempest-GroupsTest-682968728 None] Lock "cinder-quobyte-b7bc5ff5-0bc8-423e-b5e5-65f4c48923f8" released by "delete_volume" :: held 1.430s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:51:45 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-5f9e1f39-a31a-4ffc-8f23-b789d95c04d4 tempest-GroupsTest-682968728 None] Created reservations ['dbe04a7a-5a1d-4344-84e0-a865ee54a855'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:51:45 devstack cinder-volume[87119]: WARNING cinder.quota [None req-5f9e1f39-a31a-4ffc-8f23-b789d95c04d4 tempest-GroupsTest-682968728 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1926082940 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1926082940, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:51:45 devstack cinder-volume[87119]: WARNING cinder.quota [None req-5f9e1f39-a31a-4ffc-8f23-b789d95c04d4 tempest-GroupsTest-682968728 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1926082940 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1926082940, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:51:46 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-5f9e1f39-a31a-4ffc-8f23-b789d95c04d4 tempest-GroupsTest-682968728 None] Created reservations ['4eb31beb-d067-489f-ac33-1f0ed1b2e6ca', '511e5814-d692-4c21-8e9d-a5f145d0648e', '26ead2d9-81aa-4ca1-bc2e-bab0b45c08de', 'cd4ce17c-72d8-4532-b3a6-173b2121ba7d'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:51:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5f9e1f39-a31a-4ffc-8f23-b789d95c04d4 tempest-GroupsTest-682968728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5f9e1f39-a31a-4ffc-8f23-b789d95c04d4 tempest-GroupsTest-682968728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5f9e1f39-a31a-4ffc-8f23-b789d95c04d4 tempest-GroupsTest-682968728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:51:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5f9e1f39-a31a-4ffc-8f23-b789d95c04d4 tempest-GroupsTest-682968728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:51:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5f9e1f39-a31a-4ffc-8f23-b789d95c04d4 tempest-GroupsTest-682968728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5f9e1f39-a31a-4ffc-8f23-b789d95c04d4 tempest-GroupsTest-682968728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:46 devstack sudo[92577]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b0e4b92a-96be-4c33-a6cb-71a5ffc34cdb tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.5dc6e752-e000-4d3e-922b-b072c6f447d2" returned: 0 in 0.726s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:46 devstack sudo[92622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:51:46 devstack sudo[92622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b0e4b92a-96be-4c33-a6cb-71a5ffc34cdb tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:46 devstack sudo[92626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.info Nov 04 18:51:46 devstack sudo[92626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:46 devstack sudo[92622]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5f9e1f39-a31a-4ffc-8f23-b789d95c04d4 tempest-GroupsTest-682968728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.434s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:46 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-5f9e1f39-a31a-4ffc-8f23-b789d95c04d4 tempest-GroupsTest-682968728 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:51:46 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-5f9e1f39-a31a-4ffc-8f23-b789d95c04d4 tempest-GroupsTest-682968728 None] Delete group completed successfully. Nov 04 18:51:46 devstack sudo[92626]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b0e4b92a-96be-4c33-a6cb-71a5ffc34cdb tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.info" returned: 0 in 0.403s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:46 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-b0e4b92a-96be-4c33-a6cb-71a5ffc34cdb tempest-GroupSnapshotsTest-1933020210 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 18:51:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b0e4b92a-96be-4c33-a6cb-71a5ffc34cdb tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:46 devstack sudo[92632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.info Nov 04 18:51:46 devstack sudo[92632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:47 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-a463dee7-fee9-4862-8467-c3d5baf321e9 tempest-GroupsTest-682968728 None] Created reservations ['748f232f-fce6-43b9-b235-cb2f7f5b3c11'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:51:47 devstack sudo[92632]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b0e4b92a-96be-4c33-a6cb-71a5ffc34cdb tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.info" returned: 0 in 0.359s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b0e4b92a-96be-4c33-a6cb-71a5ffc34cdb tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.741s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a463dee7-fee9-4862-8467-c3d5baf321e9 tempest-GroupsTest-682968728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a463dee7-fee9-4862-8467-c3d5baf321e9 tempest-GroupsTest-682968728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a463dee7-fee9-4862-8467-c3d5baf321e9 tempest-GroupsTest-682968728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:51:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a463dee7-fee9-4862-8467-c3d5baf321e9 tempest-GroupsTest-682968728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:51:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a463dee7-fee9-4862-8467-c3d5baf321e9 tempest-GroupsTest-682968728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a463dee7-fee9-4862-8467-c3d5baf321e9 tempest-GroupsTest-682968728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:47 devstack sudo[92644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:51:47 devstack sudo[92644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:47 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-b0e4b92a-96be-4c33-a6cb-71a5ffc34cdb tempest-GroupSnapshotsTest-1933020210 None] group_snapshot 43717ad9-ce9a-423b-a4cc-86b8e802c447: created successfully Nov 04 18:51:47 devstack sudo[92644]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a463dee7-fee9-4862-8467-c3d5baf321e9 tempest-GroupsTest-682968728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.405s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:47 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-a463dee7-fee9-4862-8467-c3d5baf321e9 tempest-GroupsTest-682968728 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:51:47 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-a463dee7-fee9-4862-8467-c3d5baf321e9 tempest-GroupsTest-682968728 None] Delete group completed successfully. Nov 04 18:51:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.005s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "cinder-quobyte-5dc6e752-e000-4d3e-922b-b072c6f447d2-2aeaae97-7d02-4313-ab61-bb474b8b7405" by "_create_volume_from_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:51:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-5dc6e752-e000-4d3e-922b-b072c6f447d2-2aeaae97-7d02-4313-ab61-bb474b8b7405" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:51:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Creating volume 2aeaae97-7d02-4313-ab61-bb474b8b7405 from snapshot 5dc6e752-e000-4d3e-922b-b072c6f447d2 {{(pid=87119) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 18:51:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:51:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:51:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:51:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "cinder-quobyte-2aeaae97-7d02-4313-ab61-bb474b8b7405" by "_copy_volume_from_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:51:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-2aeaae97-7d02-4313-ab61-bb474b8b7405" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:51:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] snapshot: 5dc6e752-e000-4d3e-922b-b072c6f447d2, volume: 2aeaae97-7d02-4313-ab61-bb474b8b7405, {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 18:51:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:51:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:51:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:48 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[226c5e8a-ce3c-447d-a44c-6efc515269a8]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:51:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.5dc6e752-e000-4d3e-922b-b072c6f447d2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:48 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-04399507-ebb4-4b6f-89c4-c56118b576a0 tempest-GroupsTest-682968728 None] Group tempest-GroupsTest-Group-1758183251: creating Nov 04 18:51:49 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-04399507-ebb4-4b6f-89c4-c56118b576a0 tempest-GroupsTest-682968728 None] Group tempest-GroupsTest-Group-1758183251: created successfully Nov 04 18:51:49 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-04399507-ebb4-4b6f-89c4-c56118b576a0 tempest-GroupsTest-682968728 None] Create group completed successfully. Nov 04 18:51:49 devstack sudo[92647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.5dc6e752-e000-4d3e-922b-b072c6f447d2 Nov 04 18:51:49 devstack sudo[92647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:49 devstack sudo[92647]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.5dc6e752-e000-4d3e-922b-b072c6f447d2" returned: 0 in 0.478s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:49 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:51:49 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e611aa06-2a14-4dfb-8465-0ad32fe2e90d]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:51:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:49 devstack sudo[92653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8 Nov 04 18:51:49 devstack sudo[92653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:49 devstack sudo[92653]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8" returned: 0 in 0.443s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:49 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8 {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 18:51:49 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Creating direct copy from snapshot {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 18:51:49 devstack cinder-volume[87119]: DEBUG cinder.utils [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Path /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2aeaae97-7d02-4313-ab61-bb474b8b7405 not found in is_blk_device check {{(pid=87119) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 18:51:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2aeaae97-7d02-4313-ab61-bb474b8b7405 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:49 devstack sudo[92659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2aeaae97-7d02-4313-ab61-bb474b8b7405 Nov 04 18:51:49 devstack sudo[92659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:51 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:51:51 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Flow 'volume_create_manager' (9bf6911f-346c-4f15-9b8b-cde67885c376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:51:51 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19856fad-81a2-4de5-93cb-a0afe1f8e5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:51 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19856fad-81a2-4de5-93cb-a0afe1f8e5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1302868976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2372351a-5bbd-423d-a990-7e368a771b9b,host='devstack@QuobyteHD#QuobyteHD',id=5aafcf1a-431c-4096-9112-097284e61f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e35de31ccf41483e8e8729e15cf1955d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:51:51Z,use_quota=True,user_id='bb8e6618a659480db5137660b94835bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bcfc265-c83f-48ab-8a3e-ea91731c5e73),volume_type_id=8bcfc265-c83f-48ab-8a3e-ea91731c5e73)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:51 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a224e2-f696-45bc-b63a-6571e0aa7127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:51 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a224e2-f696-45bc-b63a-6571e0aa7127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:51 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4277ef81-aa13-4947-acc7-a7c1e371990b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:51 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4277ef81-aa13-4947-acc7-a7c1e371990b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aafcf1a-431c-4096-9112-097284e61f1a', 'volume_name': 'volume-5aafcf1a-431c-4096-9112-097284e61f1a', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:51 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec131e99-15a6-4383-80f5-77efbdeb1347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:51 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec131e99-15a6-4383-80f5-77efbdeb1347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:51 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3acda6d7-610d-420d-955d-5e342fecca85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:51 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Volume 5aafcf1a-431c-4096-9112-097284e61f1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aafcf1a-431c-4096-9112-097284e61f1a', 'volume_size': 1} Nov 04 18:51:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:01 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:UPDATE=26,cinder:SELECT=32,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:52:01 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=34,cinder:UPDATE=25,cinder:DELETE=1,cinder:INSERT=7 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:52:02 devstack sudo[92659]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2aeaae97-7d02-4313-ab61-bb474b8b7405" returned: 0 in 12.236s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:02 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Image conversion details: src /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8, size 1024.00 MB, duration 12.24 sec, destination /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2aeaae97-7d02-4313-ab61-bb474b8b7405 {{(pid=87119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 18:52:02 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Converted 1024.00 MB image at 83.68 MB/s Nov 04 18:52:02 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2aeaae97-7d02-4313-ab61-bb474b8b7405 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 18:52:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2aeaae97-7d02-4313-ab61-bb474b8b7405 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:02 devstack sudo[92776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2aeaae97-7d02-4313-ab61-bb474b8b7405 Nov 04 18:52:02 devstack sudo[92776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:02 devstack sudo[92776]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2aeaae97-7d02-4313-ab61-bb474b8b7405" returned: 0 in 0.690s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:02 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-2aeaae97-7d02-4313-ab61-bb474b8b7405" released by "_copy_volume_from_snapshot" :: held 14.008s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:02 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-5dc6e752-e000-4d3e-922b-b072c6f447d2-2aeaae97-7d02-4313-ab61-bb474b8b7405" released by "_create_volume_from_snapshot" :: held 14.152s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.189s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.427s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2372351a-5bbd-423d-a990-7e368a771b9b,created_at=2026-11-04T17:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1302868976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2372351a-5bbd-423d-a990-7e368a771b9b,host='devstack@QuobyteHD#QuobyteHD',id=5aafcf1a-431c-4096-9112-097284e61f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e35de31ccf41483e8e8729e15cf1955d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:51:51Z,use_quota=True,user_id='bb8e6618a659480db5137660b94835bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bcfc265-c83f-48ab-8a3e-ea91731c5e73),volume_type_id=8bcfc265-c83f-48ab-8a3e-ea91731c5e73)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:52:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Creating volume 5aafcf1a-431c-4096-9112-097284e61f1a {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:52:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:52:02 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:52:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5aafcf1a-431c-4096-9112-097284e61f1a 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:03 devstack sudo[92820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5aafcf1a-431c-4096-9112-097284e61f1a 1073741824 Nov 04 18:52:03 devstack sudo[92820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:03 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e330b5c3-9d34-4eae-9935-a4c3844e6b7c tempest-GroupSnapshotsTest-1933020210 None] Create group from source-snapshot-43717ad9-ce9a-423b-a4cc-86b8e802c447 completed successfully. Nov 04 18:52:03 devstack sudo[92820]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5aafcf1a-431c-4096-9112-097284e61f1a 1073741824" returned: 0 in 0.768s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:03 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-39e26cbe-c2bd-4bcc-90cb-0eb57e808056 req-f1aefb63-c522-47ac-aec8-39c8dc39f66b tempest-ServerActionsTestOtherA-347787518 None] Terminate volume connection completed successfully. Nov 04 18:52:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-39e26cbe-c2bd-4bcc-90cb-0eb57e808056 req-f1aefb63-c522-47ac-aec8-39c8dc39f66b tempest-ServerActionsTestOtherA-347787518 None] Deleting attachment 6e3ed07a-2e2f-48a4-b2e6-a1cfc62eb579. {{(pid=87119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:52:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5aafcf1a-431c-4096-9112-097284e61f1a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:03 devstack sudo[92828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5aafcf1a-431c-4096-9112-097284e61f1a Nov 04 18:52:03 devstack sudo[92828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-39e26cbe-c2bd-4bcc-90cb-0eb57e808056 req-1071fb12-7bb8-42ab-ad1f-aeb319a7a40a tempest-ServerActionsTestOtherA-347787518 None] Acquiring lock "cinder-d8632603-f2e3-4e38-88d1-40121b5912ca-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-39e26cbe-c2bd-4bcc-90cb-0eb57e808056 req-1071fb12-7bb8-42ab-ad1f-aeb319a7a40a tempest-ServerActionsTestOtherA-347787518 None] Lock "cinder-d8632603-f2e3-4e38-88d1-40121b5912ca-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-39e26cbe-c2bd-4bcc-90cb-0eb57e808056 req-1071fb12-7bb8-42ab-ad1f-aeb319a7a40a tempest-ServerActionsTestOtherA-347787518 None] Acquiring lock "cinder-quobyte-d8632603-f2e3-4e38-88d1-40121b5912ca" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-39e26cbe-c2bd-4bcc-90cb-0eb57e808056 req-1071fb12-7bb8-42ab-ad1f-aeb319a7a40a tempest-ServerActionsTestOtherA-347787518 None] Lock "cinder-quobyte-d8632603-f2e3-4e38-88d1-40121b5912ca" acquired by "delete_volume" :: waited 0.016s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:04 devstack sudo[92828]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5aafcf1a-431c-4096-9112-097284e61f1a" returned: 0 in 0.407s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:04 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:52:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:04 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7ad5d9-b4bb-4f08-98ff-b68a0d810943]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-39e26cbe-c2bd-4bcc-90cb-0eb57e808056 req-1071fb12-7bb8-42ab-ad1f-aeb319a7a40a tempest-ServerActionsTestOtherA-347787518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d8632603-f2e3-4e38-88d1-40121b5912ca {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3acda6d7-610d-420d-955d-5e342fecca85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aafcf1a-431c-4096-9112-097284e61f1a', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fa26dc6-1b96-4178-8536-2021d6f95658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:04 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Volume volume-5aafcf1a-431c-4096-9112-097284e61f1a (5aafcf1a-431c-4096-9112-097284e61f1a): created successfully Nov 04 18:52:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fa26dc6-1b96-4178-8536-2021d6f95658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Flow 'volume_create_manager' (9bf6911f-346c-4f15-9b8b-cde67885c376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:52:04 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-02cd467a-7f3f-4e0b-9791-3bf4f7077cac tempest-GroupsTest-682968728 None] Created volume successfully. Nov 04 18:52:04 devstack sudo[92832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d8632603-f2e3-4e38-88d1-40121b5912ca Nov 04 18:52:04 devstack sudo[92832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-858cbcfd-7ef2-4222-9d0c-15112aec0feb tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "cinder-quobyte-2aeaae97-7d02-4313-ab61-bb474b8b7405" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-858cbcfd-7ef2-4222-9d0c-15112aec0feb tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-2aeaae97-7d02-4313-ab61-bb474b8b7405" acquired by "delete_volume" :: waited 0.019s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:04 devstack sudo[92832]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-39e26cbe-c2bd-4bcc-90cb-0eb57e808056 req-1071fb12-7bb8-42ab-ad1f-aeb319a7a40a tempest-ServerActionsTestOtherA-347787518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d8632603-f2e3-4e38-88d1-40121b5912ca" returned: 0 in 0.527s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-39e26cbe-c2bd-4bcc-90cb-0eb57e808056 req-1071fb12-7bb8-42ab-ad1f-aeb319a7a40a tempest-ServerActionsTestOtherA-347787518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d8632603-f2e3-4e38-88d1-40121b5912ca {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:04 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[84307813-1979-4e0f-83fd-487e0f7a8105]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-858cbcfd-7ef2-4222-9d0c-15112aec0feb tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2aeaae97-7d02-4313-ab61-bb474b8b7405 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:04 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d8632603-f2e3-4e38-88d1-40121b5912ca Nov 04 18:52:04 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:04 devstack sudo[92838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2aeaae97-7d02-4313-ab61-bb474b8b7405 Nov 04 18:52:04 devstack sudo[92838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:05 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-39e26cbe-c2bd-4bcc-90cb-0eb57e808056 req-1071fb12-7bb8-42ab-ad1f-aeb319a7a40a tempest-ServerActionsTestOtherA-347787518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d8632603-f2e3-4e38-88d1-40121b5912ca" returned: 0 in 0.300s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-39e26cbe-c2bd-4bcc-90cb-0eb57e808056 req-1071fb12-7bb8-42ab-ad1f-aeb319a7a40a tempest-ServerActionsTestOtherA-347787518 None] Lock "cinder-quobyte-d8632603-f2e3-4e38-88d1-40121b5912ca" released by "delete_volume" :: held 0.908s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:05 devstack cinder-volume[87119]: DEBUG cinder.quota [req-39e26cbe-c2bd-4bcc-90cb-0eb57e808056 req-1071fb12-7bb8-42ab-ad1f-aeb319a7a40a tempest-ServerActionsTestOtherA-347787518 None] Created reservations ['11eeb7fd-5dd6-4251-84fc-b37ffe0e55fa', '22b0adb0-77bb-4f5d-b7d3-17f69b9b34ba', '14f39463-a778-4ada-8aa3-4d3d0e6762eb', '7054db0b-fd1d-4ba8-8fea-88bb3141515b'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:05 devstack sudo[92838]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-858cbcfd-7ef2-4222-9d0c-15112aec0feb tempest-GroupSnapshotsTest-1933020210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2aeaae97-7d02-4313-ab61-bb474b8b7405" returned: 0 in 0.391s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-858cbcfd-7ef2-4222-9d0c-15112aec0feb tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2aeaae97-7d02-4313-ab61-bb474b8b7405 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:05 devstack sudo[92845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2aeaae97-7d02-4313-ab61-bb474b8b7405 Nov 04 18:52:05 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-39e26cbe-c2bd-4bcc-90cb-0eb57e808056 req-1071fb12-7bb8-42ab-ad1f-aeb319a7a40a tempest-ServerActionsTestOtherA-347787518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-39e26cbe-c2bd-4bcc-90cb-0eb57e808056 req-1071fb12-7bb8-42ab-ad1f-aeb319a7a40a tempest-ServerActionsTestOtherA-347787518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [req-39e26cbe-c2bd-4bcc-90cb-0eb57e808056 req-1071fb12-7bb8-42ab-ad1f-aeb319a7a40a tempest-ServerActionsTestOtherA-347787518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [req-39e26cbe-c2bd-4bcc-90cb-0eb57e808056 req-1071fb12-7bb8-42ab-ad1f-aeb319a7a40a tempest-ServerActionsTestOtherA-347787518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-39e26cbe-c2bd-4bcc-90cb-0eb57e808056 req-1071fb12-7bb8-42ab-ad1f-aeb319a7a40a tempest-ServerActionsTestOtherA-347787518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-39e26cbe-c2bd-4bcc-90cb-0eb57e808056 req-1071fb12-7bb8-42ab-ad1f-aeb319a7a40a tempest-ServerActionsTestOtherA-347787518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:05 devstack sudo[92849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:52:05 devstack sudo[92849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:05 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-858cbcfd-7ef2-4222-9d0c-15112aec0feb tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2aeaae97-7d02-4313-ab61-bb474b8b7405" returned: 0 in 0.638s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:05 devstack sudo[92849]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-39e26cbe-c2bd-4bcc-90cb-0eb57e808056 req-1071fb12-7bb8-42ab-ad1f-aeb319a7a40a tempest-ServerActionsTestOtherA-347787518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.603s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:05 devstack cinder-volume[87119]: DEBUG cinder.manager [req-39e26cbe-c2bd-4bcc-90cb-0eb57e808056 req-1071fb12-7bb8-42ab-ad1f-aeb319a7a40a tempest-ServerActionsTestOtherA-347787518 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:52:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-858cbcfd-7ef2-4222-9d0c-15112aec0feb tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-2aeaae97-7d02-4313-ab61-bb474b8b7405" released by "delete_volume" :: held 1.133s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:05 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-39e26cbe-c2bd-4bcc-90cb-0eb57e808056 req-1071fb12-7bb8-42ab-ad1f-aeb319a7a40a tempest-ServerActionsTestOtherA-347787518 None] Deleted volume successfully. Nov 04 18:52:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-39e26cbe-c2bd-4bcc-90cb-0eb57e808056 req-1071fb12-7bb8-42ab-ad1f-aeb319a7a40a tempest-ServerActionsTestOtherA-347787518 None] Lock "cinder-d8632603-f2e3-4e38-88d1-40121b5912ca-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-858cbcfd-7ef2-4222-9d0c-15112aec0feb tempest-GroupSnapshotsTest-1933020210 None] Created reservations ['2a083d7a-9e59-4ca8-b498-21dfe0884a43'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:06 devstack cinder-volume[87119]: WARNING cinder.quota [None req-858cbcfd-7ef2-4222-9d0c-15112aec0feb tempest-GroupSnapshotsTest-1933020210 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2019765940 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2019765940, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:52:06 devstack cinder-volume[87119]: WARNING cinder.quota [None req-858cbcfd-7ef2-4222-9d0c-15112aec0feb tempest-GroupSnapshotsTest-1933020210 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2019765940 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2019765940, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-858cbcfd-7ef2-4222-9d0c-15112aec0feb tempest-GroupSnapshotsTest-1933020210 None] Created reservations ['1ff4e2f4-b1cf-4fb0-bb2d-9faf5e0f55c8', 'a56d2cdb-5128-42a2-b1b0-2c76087bec55', 'a5f2adf9-6a1f-4e3c-8629-91bab66e120e', '0022faa0-056e-4f80-ae3b-6d13e4f8094f'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c55bba67-4e66-42d4-9a55-96b86bc9a82c tempest-ServerActionsTestOtherA-347787518 None] Acquiring lock "cinder-dc75833f-19af-4f9f-8b27-0d7c314732e2-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Flow 'volume_create_manager' (b28b1585-4526-4c0b-a7a1-e1d1c03c2504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed24fee4-24f1-4ffc-805b-fb7977fedb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c55bba67-4e66-42d4-9a55-96b86bc9a82c tempest-ServerActionsTestOtherA-347787518 None] Lock "cinder-dc75833f-19af-4f9f-8b27-0d7c314732e2-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed24fee4-24f1-4ffc-805b-fb7977fedb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1576413188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2372351a-5bbd-423d-a990-7e368a771b9b,host='devstack@QuobyteHD#QuobyteHD',id=6f0de0a9-a563-47a1-91ec-6aa149bcd367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e35de31ccf41483e8e8729e15cf1955d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:52:06Z,use_quota=True,user_id='bb8e6618a659480db5137660b94835bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bcfc265-c83f-48ab-8a3e-ea91731c5e73),volume_type_id=8bcfc265-c83f-48ab-8a3e-ea91731c5e73)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb3e5f8d-3c05-4ebc-8c70-601a0b788033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb3e5f8d-3c05-4ebc-8c70-601a0b788033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57810f6d-491e-4596-93fd-0695f07657ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57810f6d-491e-4596-93fd-0695f07657ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f0de0a9-a563-47a1-91ec-6aa149bcd367', 'volume_name': 'volume-6f0de0a9-a563-47a1-91ec-6aa149bcd367', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa4c2c0-a0aa-40b8-b786-13d983952b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa4c2c0-a0aa-40b8-b786-13d983952b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7170f91e-2035-43d5-aca3-a437b1090f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:06 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Volume 6f0de0a9-a563-47a1-91ec-6aa149bcd367: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f0de0a9-a563-47a1-91ec-6aa149bcd367', 'volume_size': 1} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2372351a-5bbd-423d-a990-7e368a771b9b,created_at=2026-11-04T17:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1576413188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2372351a-5bbd-423d-a990-7e368a771b9b,host='devstack@QuobyteHD#QuobyteHD',id=6f0de0a9-a563-47a1-91ec-6aa149bcd367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e35de31ccf41483e8e8729e15cf1955d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:52:06Z,use_quota=True,user_id='bb8e6618a659480db5137660b94835bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bcfc265-c83f-48ab-8a3e-ea91731c5e73),volume_type_id=8bcfc265-c83f-48ab-8a3e-ea91731c5e73)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Creating volume 6f0de0a9-a563-47a1-91ec-6aa149bcd367 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:52:06 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6f0de0a9-a563-47a1-91ec-6aa149bcd367 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:06 devstack sudo[92853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6f0de0a9-a563-47a1-91ec-6aa149bcd367 1073741824 Nov 04 18:52:06 devstack sudo[92853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c55bba67-4e66-42d4-9a55-96b86bc9a82c tempest-ServerActionsTestOtherA-347787518 None] Acquiring lock "cinder-quobyte-dc75833f-19af-4f9f-8b27-0d7c314732e2" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-858cbcfd-7ef2-4222-9d0c-15112aec0feb tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-858cbcfd-7ef2-4222-9d0c-15112aec0feb tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-858cbcfd-7ef2-4222-9d0c-15112aec0feb tempest-GroupSnapshotsTest-1933020210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-858cbcfd-7ef2-4222-9d0c-15112aec0feb tempest-GroupSnapshotsTest-1933020210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-858cbcfd-7ef2-4222-9d0c-15112aec0feb tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-858cbcfd-7ef2-4222-9d0c-15112aec0feb tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c55bba67-4e66-42d4-9a55-96b86bc9a82c tempest-ServerActionsTestOtherA-347787518 None] Lock "cinder-quobyte-dc75833f-19af-4f9f-8b27-0d7c314732e2" acquired by "delete_volume" :: waited 0.059s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:06 devstack sudo[92856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:52:06 devstack sudo[92856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4382228-4027-4124-a2ca-1f957f4b81ab]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c55bba67-4e66-42d4-9a55-96b86bc9a82c tempest-ServerActionsTestOtherA-347787518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dc75833f-19af-4f9f-8b27-0d7c314732e2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:07 devstack sudo[92860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dc75833f-19af-4f9f-8b27-0d7c314732e2 Nov 04 18:52:07 devstack sudo[92860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:07 devstack sudo[92856]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-858cbcfd-7ef2-4222-9d0c-15112aec0feb tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.383s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:07 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-858cbcfd-7ef2-4222-9d0c-15112aec0feb tempest-GroupSnapshotsTest-1933020210 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:52:07 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-858cbcfd-7ef2-4222-9d0c-15112aec0feb tempest-GroupSnapshotsTest-1933020210 None] Delete group completed successfully. Nov 04 18:52:07 devstack sudo[92853]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6f0de0a9-a563-47a1-91ec-6aa149bcd367 1073741824" returned: 0 in 0.641s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6f0de0a9-a563-47a1-91ec-6aa149bcd367 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:07 devstack sudo[92867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6f0de0a9-a563-47a1-91ec-6aa149bcd367 Nov 04 18:52:07 devstack sudo[92867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:07 devstack sudo[92860]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c55bba67-4e66-42d4-9a55-96b86bc9a82c tempest-ServerActionsTestOtherA-347787518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dc75833f-19af-4f9f-8b27-0d7c314732e2" returned: 0 in 0.546s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c55bba67-4e66-42d4-9a55-96b86bc9a82c tempest-ServerActionsTestOtherA-347787518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dc75833f-19af-4f9f-8b27-0d7c314732e2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:07 devstack sudo[92871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dc75833f-19af-4f9f-8b27-0d7c314732e2 Nov 04 18:52:07 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:07 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-00f8385d-85ca-4b8f-838f-c1e1c987fc2d tempest-GroupSnapshotsTest-1933020210 None] group_snapshot 43717ad9-ce9a-423b-a4cc-86b8e802c447: deleting Nov 04 18:52:07 devstack sudo[92867]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6f0de0a9-a563-47a1-91ec-6aa149bcd367" returned: 0 in 0.567s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:52:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-00f8385d-85ca-4b8f-838f-c1e1c987fc2d tempest-GroupSnapshotsTest-1933020210 None] group_snapshot 43717ad9-ce9a-423b-a4cc-86b8e802c447: deleting {{(pid=87119) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 04 18:52:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7170f91e-2035-43d5-aca3-a437b1090f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f0de0a9-a563-47a1-91ec-6aa149bcd367', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba0802c-09cb-4a97-88ce-83beea77a9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:08 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Volume volume-6f0de0a9-a563-47a1-91ec-6aa149bcd367 (6f0de0a9-a563-47a1-91ec-6aa149bcd367): created successfully Nov 04 18:52:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba0802c-09cb-4a97-88ce-83beea77a9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Flow 'volume_create_manager' (b28b1585-4526-4c0b-a7a1-e1d1c03c2504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:52:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-00f8385d-85ca-4b8f-838f-c1e1c987fc2d tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "cinder-quobyte-6d7e3566-329c-4ab8-b911-efb417b4cdf8" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:08 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:08 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-0c4e7f10-812b-42cf-81a1-dd23ef84b25d tempest-GroupsTest-682968728 None] Created volume successfully. Nov 04 18:52:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-00f8385d-85ca-4b8f-838f-c1e1c987fc2d tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-6d7e3566-329c-4ab8-b911-efb417b4cdf8" acquired by "delete_snapshot" :: waited 0.079s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-00f8385d-85ca-4b8f-838f-c1e1c987fc2d tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "cinder-quobyte-5dc6e752-e000-4d3e-922b-b072c6f447d2" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c55bba67-4e66-42d4-9a55-96b86bc9a82c tempest-ServerActionsTestOtherA-347787518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dc75833f-19af-4f9f-8b27-0d7c314732e2" returned: 0 in 0.855s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c55bba67-4e66-42d4-9a55-96b86bc9a82c tempest-ServerActionsTestOtherA-347787518 None] Lock "cinder-quobyte-dc75833f-19af-4f9f-8b27-0d7c314732e2" released by "delete_volume" :: held 1.532s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-00f8385d-85ca-4b8f-838f-c1e1c987fc2d tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-5dc6e752-e000-4d3e-922b-b072c6f447d2" acquired by "_delete_snapshot" :: waited 0.090s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-00f8385d-85ca-4b8f-838f-c1e1c987fc2d tempest-GroupSnapshotsTest-1933020210 None] Deleting offline snapshot 5dc6e752-e000-4d3e-922b-b072c6f447d2 of volume 6d7e3566-329c-4ab8-b911-efb417b4cdf8 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:52:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-00f8385d-85ca-4b8f-838f-c1e1c987fc2d tempest-GroupSnapshotsTest-1933020210 None] snapshot_file for this snap is: volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.5dc6e752-e000-4d3e-922b-b072c6f447d2 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:52:08 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6022952-02f6-4995-b0dc-2404e4fb650b]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-00f8385d-85ca-4b8f-838f-c1e1c987fc2d tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.5dc6e752-e000-4d3e-922b-b072c6f447d2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:08 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-c55bba67-4e66-42d4-9a55-96b86bc9a82c tempest-ServerActionsTestOtherA-347787518 None] Created reservations ['aa8383fe-a9d0-410e-9767-12f70661ef17', '85314580-20dc-449d-8eab-4ffd830af139', '1497dcc7-9d43-473e-9db7-ac7bf9cf9f94', '6540d508-7d49-43e0-9645-ef0552166ac0'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:08 devstack sudo[92882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.5dc6e752-e000-4d3e-922b-b072c6f447d2 Nov 04 18:52:08 devstack sudo[92882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c55bba67-4e66-42d4-9a55-96b86bc9a82c tempest-ServerActionsTestOtherA-347787518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c55bba67-4e66-42d4-9a55-96b86bc9a82c tempest-ServerActionsTestOtherA-347787518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c55bba67-4e66-42d4-9a55-96b86bc9a82c tempest-ServerActionsTestOtherA-347787518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c55bba67-4e66-42d4-9a55-96b86bc9a82c tempest-ServerActionsTestOtherA-347787518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c55bba67-4e66-42d4-9a55-96b86bc9a82c tempest-ServerActionsTestOtherA-347787518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c55bba67-4e66-42d4-9a55-96b86bc9a82c tempest-ServerActionsTestOtherA-347787518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:08 devstack sudo[92888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:52:08 devstack sudo[92888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:09 devstack sudo[92888]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c55bba67-4e66-42d4-9a55-96b86bc9a82c tempest-ServerActionsTestOtherA-347787518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.543s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:09 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-c55bba67-4e66-42d4-9a55-96b86bc9a82c tempest-ServerActionsTestOtherA-347787518 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:52:09 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-c55bba67-4e66-42d4-9a55-96b86bc9a82c tempest-ServerActionsTestOtherA-347787518 None] Deleted volume successfully. Nov 04 18:52:09 devstack sudo[92882]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-00f8385d-85ca-4b8f-838f-c1e1c987fc2d tempest-GroupSnapshotsTest-1933020210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.5dc6e752-e000-4d3e-922b-b072c6f447d2" returned: 0 in 0.902s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-00f8385d-85ca-4b8f-838f-c1e1c987fc2d tempest-GroupSnapshotsTest-1933020210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:52:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c55bba67-4e66-42d4-9a55-96b86bc9a82c tempest-ServerActionsTestOtherA-347787518 None] Lock "cinder-dc75833f-19af-4f9f-8b27-0d7c314732e2-delete_volume" released by "delete_volume" :: held 3.017s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:09 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d957b4-4380-438f-afcf-bfc36ab608b9]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-00f8385d-85ca-4b8f-838f-c1e1c987fc2d tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:09 devstack sudo[92923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8 Nov 04 18:52:09 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:10 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-52f7286d-60d8-49f3-a083-8bb221f7c965 tempest-GroupsTest-682968728 None] Update group completed successfully. Nov 04 18:52:10 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-00f8385d-85ca-4b8f-838f-c1e1c987fc2d tempest-GroupSnapshotsTest-1933020210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8" returned: 0 in 1.146s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-00f8385d-85ca-4b8f-838f-c1e1c987fc2d tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.5dc6e752-e000-4d3e-922b-b072c6f447d2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:10 devstack sudo[92957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.5dc6e752-e000-4d3e-922b-b072c6f447d2 Nov 04 18:52:10 devstack sudo[92957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:11 devstack sudo[92957]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-00f8385d-85ca-4b8f-838f-c1e1c987fc2d tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.5dc6e752-e000-4d3e-922b-b072c6f447d2" returned: 0 in 0.469s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-00f8385d-85ca-4b8f-838f-c1e1c987fc2d tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.5dc6e752-e000-4d3e-922b-b072c6f447d2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:11 devstack sudo[92964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.5dc6e752-e000-4d3e-922b-b072c6f447d2 Nov 04 18:52:11 devstack sudo[92964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:11 devstack sudo[92964]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-00f8385d-85ca-4b8f-838f-c1e1c987fc2d tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8.5dc6e752-e000-4d3e-922b-b072c6f447d2" returned: 0 in 0.527s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:11 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-00f8385d-85ca-4b8f-838f-c1e1c987fc2d tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-5dc6e752-e000-4d3e-922b-b072c6f447d2" released by "_delete_snapshot" :: held 3.335s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:11 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-00f8385d-85ca-4b8f-838f-c1e1c987fc2d tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-6d7e3566-329c-4ab8-b911-efb417b4cdf8" released by "delete_snapshot" :: held 3.454s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:11 devstack cinder-volume[87119]: WARNING cinder.quota [None req-00f8385d-85ca-4b8f-838f-c1e1c987fc2d tempest-GroupSnapshotsTest-1933020210 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2019765940 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2019765940, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:52:11 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-3f4e403b-7234-41fd-ad97-749fac8e74c5 tempest-GroupsTest-682968728 None] Update group completed successfully. Nov 04 18:52:11 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-00f8385d-85ca-4b8f-838f-c1e1c987fc2d tempest-GroupSnapshotsTest-1933020210 None] Created reservations ['55c09b75-92d8-4a21-b3f8-5d4bb8947215', '12e245d1-b8bc-4f9e-b66d-9aeb31acc227', 'bede75a2-97d2-403d-86c9-97b231675f45', '16622d9e-62a1-4312-8297-2802616592b1'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:11 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-00f8385d-85ca-4b8f-838f-c1e1c987fc2d tempest-GroupSnapshotsTest-1933020210 None] group_snapshot 43717ad9-ce9a-423b-a4cc-86b8e802c447: deleted successfully Nov 04 18:52:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3903bf17-a2b6-486c-aac6-2e7d73bdfb56 tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "cinder-quobyte-6d7e3566-329c-4ab8-b911-efb417b4cdf8" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3903bf17-a2b6-486c-aac6-2e7d73bdfb56 tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-6d7e3566-329c-4ab8-b911-efb417b4cdf8" acquired by "delete_volume" :: waited 0.031s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afc5188-bb2d-4eea-8426-f4acc6ad39ad]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3903bf17-a2b6-486c-aac6-2e7d73bdfb56 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:13 devstack sudo[92971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8 Nov 04 18:52:13 devstack sudo[92971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Flow 'volume_create_manager' (1a6cf8b9-1dda-4837-8eff-ef53b06469c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b558902-c49b-4c34-a502-48d365ab6494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b558902-c49b-4c34-a502-48d365ab6494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1262237488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4afc5c7b-3f57-436d-8f7d-d534dc992f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='070b74dce7834fe7b7b129ab66394ef4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:52:13Z,use_quota=True,user_id='aa248738cb9b494db17ae805ba294d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3621eedd-5e0d-4520-9a8c-9d9414e0ac89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3621eedd-5e0d-4520-9a8c-9d9414e0ac89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b74a45-8cf0-4414-b075-b63e222c82cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b74a45-8cf0-4414-b075-b63e222c82cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4afc5c7b-3f57-436d-8f7d-d534dc992f75', 'volume_name': 'volume-4afc5c7b-3f57-436d-8f7d-d534dc992f75', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (646a4797-db58-4285-81bd-d52820db2605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (646a4797-db58-4285-81bd-d52820db2605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d70ca3c-ed17-416d-9153-88dfb5a22fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:13 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Volume 4afc5c7b-3f57-436d-8f7d-d534dc992f75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4afc5c7b-3f57-436d-8f7d-d534dc992f75', 'volume_size': 1} Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1262237488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4afc5c7b-3f57-436d-8f7d-d534dc992f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='070b74dce7834fe7b7b129ab66394ef4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:52:13Z,use_quota=True,user_id='aa248738cb9b494db17ae805ba294d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Creating volume 4afc5c7b-3f57-436d-8f7d-d534dc992f75 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:52:13 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4afc5c7b-3f57-436d-8f7d-d534dc992f75 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:13 devstack sudo[92976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4afc5c7b-3f57-436d-8f7d-d534dc992f75 1073741824 Nov 04 18:52:13 devstack sudo[92976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:13 devstack sudo[92971]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3903bf17-a2b6-486c-aac6-2e7d73bdfb56 tempest-GroupSnapshotsTest-1933020210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8" returned: 0 in 0.603s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3903bf17-a2b6-486c-aac6-2e7d73bdfb56 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:13 devstack sudo[92978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8 Nov 04 18:52:13 devstack sudo[92978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-392bf23e-4beb-47bb-a802-ff7ffe1f9f3a tempest-GroupsTest-682968728 None] Acquiring lock "cinder-quobyte-5aafcf1a-431c-4096-9112-097284e61f1a" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-392bf23e-4beb-47bb-a802-ff7ffe1f9f3a tempest-GroupsTest-682968728 None] Lock "cinder-quobyte-5aafcf1a-431c-4096-9112-097284e61f1a" acquired by "delete_volume" :: waited 0.029s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd02e95-6df0-4556-853c-f37ce4be1924]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-392bf23e-4beb-47bb-a802-ff7ffe1f9f3a tempest-GroupsTest-682968728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5aafcf1a-431c-4096-9112-097284e61f1a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:13 devstack sudo[92978]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3903bf17-a2b6-486c-aac6-2e7d73bdfb56 tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6d7e3566-329c-4ab8-b911-efb417b4cdf8" returned: 0 in 0.315s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:13 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3903bf17-a2b6-486c-aac6-2e7d73bdfb56 tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-6d7e3566-329c-4ab8-b911-efb417b4cdf8" released by "delete_volume" :: held 1.013s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:14 devstack sudo[92984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5aafcf1a-431c-4096-9112-097284e61f1a Nov 04 18:52:14 devstack sudo[92984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:14 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-3903bf17-a2b6-486c-aac6-2e7d73bdfb56 tempest-GroupSnapshotsTest-1933020210 None] Created reservations ['ba0364c6-af93-4e6a-81f0-4bdf11497400'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:14 devstack cinder-volume[87119]: WARNING cinder.db.api [None req-3903bf17-a2b6-486c-aac6-2e7d73bdfb56 tempest-GroupSnapshotsTest-1933020210 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2019765940'] Nov 04 18:52:14 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-3903bf17-a2b6-486c-aac6-2e7d73bdfb56 tempest-GroupSnapshotsTest-1933020210 None] Created reservations ['379278de-5db6-40bf-a333-b00c11c00abb', 'b3ea641b-03b8-4566-a0bb-402f998c0c4b', '77d7dc80-054c-4ff2-b639-bdbcc4374210', 'cbfc5045-cbd8-4e1d-8f0b-da47ca1199db'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:14 devstack sudo[92976]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4afc5c7b-3f57-436d-8f7d-d534dc992f75 1073741824" returned: 0 in 0.607s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4afc5c7b-3f57-436d-8f7d-d534dc992f75 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:14 devstack sudo[92988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4afc5c7b-3f57-436d-8f7d-d534dc992f75 Nov 04 18:52:14 devstack sudo[92988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3903bf17-a2b6-486c-aac6-2e7d73bdfb56 tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3903bf17-a2b6-486c-aac6-2e7d73bdfb56 tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3903bf17-a2b6-486c-aac6-2e7d73bdfb56 tempest-GroupSnapshotsTest-1933020210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3903bf17-a2b6-486c-aac6-2e7d73bdfb56 tempest-GroupSnapshotsTest-1933020210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3903bf17-a2b6-486c-aac6-2e7d73bdfb56 tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3903bf17-a2b6-486c-aac6-2e7d73bdfb56 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:14 devstack sudo[92990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:52:14 devstack sudo[92990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:14 devstack sudo[92984]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-392bf23e-4beb-47bb-a802-ff7ffe1f9f3a tempest-GroupsTest-682968728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5aafcf1a-431c-4096-9112-097284e61f1a" returned: 0 in 0.561s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-392bf23e-4beb-47bb-a802-ff7ffe1f9f3a tempest-GroupsTest-682968728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5aafcf1a-431c-4096-9112-097284e61f1a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:14 devstack sudo[92995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5aafcf1a-431c-4096-9112-097284e61f1a Nov 04 18:52:14 devstack sudo[92995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:14 devstack sudo[92988]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4afc5c7b-3f57-436d-8f7d-d534dc992f75" returned: 0 in 0.355s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:52:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d70ca3c-ed17-416d-9153-88dfb5a22fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4afc5c7b-3f57-436d-8f7d-d534dc992f75', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5418e313-6ab6-412e-8a46-7301cff56890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:14 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Volume volume-4afc5c7b-3f57-436d-8f7d-d534dc992f75 (4afc5c7b-3f57-436d-8f7d-d534dc992f75): created successfully Nov 04 18:52:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5418e313-6ab6-412e-8a46-7301cff56890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Flow 'volume_create_manager' (1a6cf8b9-1dda-4837-8eff-ef53b06469c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:52:14 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-a4fcfc34-a4c8-48ad-bf86-37eb0de683b2 tempest-ServersNegativeTestJSON-1622364679 None] Created volume successfully. Nov 04 18:52:14 devstack sudo[92990]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3903bf17-a2b6-486c-aac6-2e7d73bdfb56 tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.466s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:14 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-3903bf17-a2b6-486c-aac6-2e7d73bdfb56 tempest-GroupSnapshotsTest-1933020210 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:52:14 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-3903bf17-a2b6-486c-aac6-2e7d73bdfb56 tempest-GroupSnapshotsTest-1933020210 None] Delete group completed successfully. Nov 04 18:52:14 devstack sudo[92995]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-392bf23e-4beb-47bb-a802-ff7ffe1f9f3a tempest-GroupsTest-682968728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5aafcf1a-431c-4096-9112-097284e61f1a" returned: 0 in 0.405s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-392bf23e-4beb-47bb-a802-ff7ffe1f9f3a tempest-GroupsTest-682968728 None] Lock "cinder-quobyte-5aafcf1a-431c-4096-9112-097284e61f1a" released by "delete_volume" :: held 1.025s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-392bf23e-4beb-47bb-a802-ff7ffe1f9f3a tempest-GroupsTest-682968728 None] Acquiring lock "cinder-quobyte-6f0de0a9-a563-47a1-91ec-6aa149bcd367" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-392bf23e-4beb-47bb-a802-ff7ffe1f9f3a tempest-GroupsTest-682968728 None] Lock "cinder-quobyte-6f0de0a9-a563-47a1-91ec-6aa149bcd367" acquired by "delete_volume" :: waited 0.013s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:14 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb07aa07-090b-4631-9fec-8f285220e1ce]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-392bf23e-4beb-47bb-a802-ff7ffe1f9f3a tempest-GroupsTest-682968728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6f0de0a9-a563-47a1-91ec-6aa149bcd367 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:15 devstack sudo[93000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6f0de0a9-a563-47a1-91ec-6aa149bcd367 Nov 04 18:52:15 devstack sudo[93000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:15 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-36139040-d0ab-4617-b40f-50a944fce4ff tempest-GroupSnapshotsTest-1933020210 None] Group tempest-GroupSnapshotsTest-Group-533428399: creating Nov 04 18:52:15 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-36139040-d0ab-4617-b40f-50a944fce4ff tempest-GroupSnapshotsTest-1933020210 None] Group tempest-GroupSnapshotsTest-Group-533428399: created successfully Nov 04 18:52:15 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-36139040-d0ab-4617-b40f-50a944fce4ff tempest-GroupSnapshotsTest-1933020210 None] Create group completed successfully. Nov 04 18:52:15 devstack sudo[93000]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-392bf23e-4beb-47bb-a802-ff7ffe1f9f3a tempest-GroupsTest-682968728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6f0de0a9-a563-47a1-91ec-6aa149bcd367" returned: 0 in 0.389s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-392bf23e-4beb-47bb-a802-ff7ffe1f9f3a tempest-GroupsTest-682968728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6f0de0a9-a563-47a1-91ec-6aa149bcd367 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:15 devstack sudo[93006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6f0de0a9-a563-47a1-91ec-6aa149bcd367 Nov 04 18:52:15 devstack sudo[93006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:15 devstack sudo[93006]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-392bf23e-4beb-47bb-a802-ff7ffe1f9f3a tempest-GroupsTest-682968728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6f0de0a9-a563-47a1-91ec-6aa149bcd367" returned: 0 in 0.298s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:15 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-392bf23e-4beb-47bb-a802-ff7ffe1f9f3a tempest-GroupsTest-682968728 None] Lock "cinder-quobyte-6f0de0a9-a563-47a1-91ec-6aa149bcd367" released by "delete_volume" :: held 0.740s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:15 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-392bf23e-4beb-47bb-a802-ff7ffe1f9f3a tempest-GroupsTest-682968728 None] Created reservations ['6dff4e62-45cc-4b0b-ae6e-f0d20da2154d'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:15 devstack cinder-volume[87119]: WARNING cinder.quota [None req-392bf23e-4beb-47bb-a802-ff7ffe1f9f3a tempest-GroupsTest-682968728 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1215161209 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1215161209, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:52:15 devstack cinder-volume[87119]: WARNING cinder.quota [None req-392bf23e-4beb-47bb-a802-ff7ffe1f9f3a tempest-GroupsTest-682968728 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1215161209 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1215161209, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:52:15 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-392bf23e-4beb-47bb-a802-ff7ffe1f9f3a tempest-GroupsTest-682968728 None] Created reservations ['f5711cf0-74a9-4832-b301-af403cf0923b', '22ca39a1-8146-47da-b46c-37765fe01d40', '95c71e7f-53dd-43e7-bba3-46ac3c8a2df8', '81624929-1be1-4bd8-9778-796b95bfe797'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:15 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-392bf23e-4beb-47bb-a802-ff7ffe1f9f3a tempest-GroupsTest-682968728 None] Created reservations ['bbedcd52-26ad-473e-9a24-4a6144a04af2', 'e99c46ec-0536-4994-917c-9911295245a8', '117726fb-4a6c-484b-8028-1c90c5d2324a', '1cc7b1ac-4550-48bf-8d28-32e8a655e908'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-392bf23e-4beb-47bb-a802-ff7ffe1f9f3a tempest-GroupsTest-682968728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-392bf23e-4beb-47bb-a802-ff7ffe1f9f3a tempest-GroupsTest-682968728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:16 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-392bf23e-4beb-47bb-a802-ff7ffe1f9f3a tempest-GroupsTest-682968728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:16 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-392bf23e-4beb-47bb-a802-ff7ffe1f9f3a tempest-GroupsTest-682968728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-392bf23e-4beb-47bb-a802-ff7ffe1f9f3a tempest-GroupsTest-682968728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-392bf23e-4beb-47bb-a802-ff7ffe1f9f3a tempest-GroupsTest-682968728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:16 devstack sudo[93010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:52:16 devstack sudo[93010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:16 devstack sudo[93010]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-392bf23e-4beb-47bb-a802-ff7ffe1f9f3a tempest-GroupsTest-682968728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.297s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:16 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-392bf23e-4beb-47bb-a802-ff7ffe1f9f3a tempest-GroupsTest-682968728 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:52:16 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-392bf23e-4beb-47bb-a802-ff7ffe1f9f3a tempest-GroupsTest-682968728 None] Delete group completed successfully. Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Flow 'volume_create_manager' (371e65aa-906e-442c-9e37-7a9725516869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17fd2632-7429-4252-83fc-69611001fd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17fd2632-7429-4252-83fc-69611001fd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-250538462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa9a1d3a-5fbb-4432-8585-f25d43bcd5af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='070b74dce7834fe7b7b129ab66394ef4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:52:17Z,use_quota=True,user_id='aa248738cb9b494db17ae805ba294d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8beb8ac3-df8f-425d-b3f6-b80e794270b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8beb8ac3-df8f-425d-b3f6-b80e794270b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a8b116-3bbe-4913-80ea-ca7e64b87152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a8b116-3bbe-4913-80ea-ca7e64b87152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa9a1d3a-5fbb-4432-8585-f25d43bcd5af', 'volume_name': 'volume-aa9a1d3a-5fbb-4432-8585-f25d43bcd5af', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f148e84-0bf9-4a5f-be07-05094a287187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f148e84-0bf9-4a5f-be07-05094a287187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d3f35d0-d429-4f5b-b4ed-41a1e3056d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:17 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Volume aa9a1d3a-5fbb-4432-8585-f25d43bcd5af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa9a1d3a-5fbb-4432-8585-f25d43bcd5af', 'volume_size': 1} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-250538462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa9a1d3a-5fbb-4432-8585-f25d43bcd5af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='070b74dce7834fe7b7b129ab66394ef4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:52:17Z,use_quota=True,user_id='aa248738cb9b494db17ae805ba294d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Creating volume aa9a1d3a-5fbb-4432-8585-f25d43bcd5af {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:52:17 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-aa9a1d3a-5fbb-4432-8585-f25d43bcd5af 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:52:17 devstack sudo[93016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-aa9a1d3a-5fbb-4432-8585-f25d43bcd5af 1073741824 Nov 04 18:52:17 devstack sudo[93016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Flow 'volume_create_manager' (ed4cd2f5-25b2-45cd-8384-77437c905186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a6bf93-6eac-4ed4-827b-f0cd460453fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a6bf93-6eac-4ed4-827b-f0cd460453fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-653092714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d6ab974-974d-4cc2-81b2-9c0febdf45a9,host='devstack@QuobyteHD#QuobyteHD',id=f8563220-2d68-49c4-860f-ac6d63a65ee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68623afa0c214601bdec4e8e175718dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:52:17Z,use_quota=True,user_id='99a5e0cbf21448169b721faeea4317f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9865c4ce-2c64-4563-96e3-2227245e7d7f),volume_type_id=9865c4ce-2c64-4563-96e3-2227245e7d7f)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ce149a0-890c-489e-bc40-97cb03702eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ce149a0-890c-489e-bc40-97cb03702eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09042141-5eb9-4204-a6f6-8ffcb89a262f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09042141-5eb9-4204-a6f6-8ffcb89a262f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8563220-2d68-49c4-860f-ac6d63a65ee5', 'volume_name': 'volume-f8563220-2d68-49c4-860f-ac6d63a65ee5', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a6752d-654f-4bd4-a6ec-324491ad890b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a6752d-654f-4bd4-a6ec-324491ad890b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e519886f-f016-4367-9058-40e4c3f99d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:17 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Volume f8563220-2d68-49c4-860f-ac6d63a65ee5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8563220-2d68-49c4-860f-ac6d63a65ee5', 'volume_size': 1} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:17 devstack sudo[93016]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-aa9a1d3a-5fbb-4432-8585-f25d43bcd5af 1073741824" returned: 0 in 0.453s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-aa9a1d3a-5fbb-4432-8585-f25d43bcd5af {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:18 devstack sudo[93022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-aa9a1d3a-5fbb-4432-8585-f25d43bcd5af Nov 04 18:52:18 devstack sudo[93022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:18 devstack sudo[93022]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-aa9a1d3a-5fbb-4432-8585-f25d43bcd5af" returned: 0 in 0.293s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:18 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:52:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.692s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:18 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0d6ab974-974d-4cc2-81b2-9c0febdf45a9,created_at=2026-11-04T17:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-653092714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d6ab974-974d-4cc2-81b2-9c0febdf45a9,host='devstack@QuobyteHD#QuobyteHD',id=f8563220-2d68-49c4-860f-ac6d63a65ee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68623afa0c214601bdec4e8e175718dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:52:17Z,use_quota=True,user_id='99a5e0cbf21448169b721faeea4317f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9865c4ce-2c64-4563-96e3-2227245e7d7f),volume_type_id=9865c4ce-2c64-4563-96e3-2227245e7d7f)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:52:18 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Creating volume f8563220-2d68-49c4-860f-ac6d63a65ee5 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:52:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:18 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:18 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:18 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:52:18 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:52:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d3f35d0-d429-4f5b-b4ed-41a1e3056d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa9a1d3a-5fbb-4432-8585-f25d43bcd5af', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41bf8433-35ad-4a40-a9c8-dea38ee89cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:18 devstack sudo[93025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5 1073741824 Nov 04 18:52:18 devstack sudo[93025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:18 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Volume volume-aa9a1d3a-5fbb-4432-8585-f25d43bcd5af (aa9a1d3a-5fbb-4432-8585-f25d43bcd5af): created successfully Nov 04 18:52:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41bf8433-35ad-4a40-a9c8-dea38ee89cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Flow 'volume_create_manager' (371e65aa-906e-442c-9e37-7a9725516869) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:52:18 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-3851d304-c145-4bf5-8a77-8ab4d58550f1 tempest-ServersNegativeTestJSON-1622364679 None] Created volume successfully. Nov 04 18:52:18 devstack sudo[93025]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5 1073741824" returned: 0 in 0.585s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:18 devstack sudo[93031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5 Nov 04 18:52:18 devstack sudo[93031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:19 devstack sudo[93031]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5" returned: 0 in 0.371s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:19 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:52:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:19 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e519886f-f016-4367-9058-40e4c3f99d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8563220-2d68-49c4-860f-ac6d63a65ee5', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:19 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf45e04-ad0e-4a54-8f90-eb8944e52b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:19 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Volume volume-f8563220-2d68-49c4-860f-ac6d63a65ee5 (f8563220-2d68-49c4-860f-ac6d63a65ee5): created successfully Nov 04 18:52:19 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf45e04-ad0e-4a54-8f90-eb8944e52b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:19 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Flow 'volume_create_manager' (ed4cd2f5-25b2-45cd-8384-77437c905186) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:52:19 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-d9023b00-4cd0-4cb3-a838-f3d902e79970 tempest-GroupSnapshotsTest-1933020210 None] Created volume successfully. Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5fceea15-a5ea-4d50-865d-4abc47049d1d tempest-ServersNegativeTestJSON-1622364679 None] Acquiring lock "cinder-aa9a1d3a-5fbb-4432-8585-f25d43bcd5af-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5fceea15-a5ea-4d50-865d-4abc47049d1d tempest-ServersNegativeTestJSON-1622364679 None] Lock "cinder-aa9a1d3a-5fbb-4432-8585-f25d43bcd5af-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5fceea15-a5ea-4d50-865d-4abc47049d1d tempest-ServersNegativeTestJSON-1622364679 None] Acquiring lock "cinder-quobyte-aa9a1d3a-5fbb-4432-8585-f25d43bcd5af" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5fceea15-a5ea-4d50-865d-4abc47049d1d tempest-ServersNegativeTestJSON-1622364679 None] Lock "cinder-quobyte-aa9a1d3a-5fbb-4432-8585-f25d43bcd5af" acquired by "delete_volume" :: waited 0.018s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5e997c-3cbe-4d24-8b70-6485386400b8]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5fceea15-a5ea-4d50-865d-4abc47049d1d tempest-ServersNegativeTestJSON-1622364679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-aa9a1d3a-5fbb-4432-8585-f25d43bcd5af {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:20 devstack sudo[93036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-aa9a1d3a-5fbb-4432-8585-f25d43bcd5af Nov 04 18:52:20 devstack sudo[93036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Flow 'volume_create_manager' (1b84ad71-b030-4dfe-ad15-334aa9d87670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e54575-e9a9-48e0-b900-b922c4fa46f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e54575-e9a9-48e0-b900-b922c4fa46f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1208542810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d6ab974-974d-4cc2-81b2-9c0febdf45a9,host='devstack@QuobyteHD#QuobyteHD',id=25d17a30-37cd-4205-adf9-56fc91a8b135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68623afa0c214601bdec4e8e175718dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:52:20Z,use_quota=True,user_id='99a5e0cbf21448169b721faeea4317f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9865c4ce-2c64-4563-96e3-2227245e7d7f),volume_type_id=9865c4ce-2c64-4563-96e3-2227245e7d7f)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e24db19d-3525-4f2f-a7f8-0938fa1be185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e24db19d-3525-4f2f-a7f8-0938fa1be185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f009ef-0eaf-4171-bd67-39c19091c127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f009ef-0eaf-4171-bd67-39c19091c127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25d17a30-37cd-4205-adf9-56fc91a8b135', 'volume_name': 'volume-25d17a30-37cd-4205-adf9-56fc91a8b135', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (062410b5-b47e-4ae7-86f5-4d8efe6984b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (062410b5-b47e-4ae7-86f5-4d8efe6984b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33bd405f-75e6-4100-b665-4a00476ac941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:20 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Volume 25d17a30-37cd-4205-adf9-56fc91a8b135: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25d17a30-37cd-4205-adf9-56fc91a8b135', 'volume_size': 1} Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0d6ab974-974d-4cc2-81b2-9c0febdf45a9,created_at=2026-11-04T17:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1208542810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d6ab974-974d-4cc2-81b2-9c0febdf45a9,host='devstack@QuobyteHD#QuobyteHD',id=25d17a30-37cd-4205-adf9-56fc91a8b135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68623afa0c214601bdec4e8e175718dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:52:20Z,use_quota=True,user_id='99a5e0cbf21448169b721faeea4317f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9865c4ce-2c64-4563-96e3-2227245e7d7f),volume_type_id=9865c4ce-2c64-4563-96e3-2227245e7d7f)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Creating volume 25d17a30-37cd-4205-adf9-56fc91a8b135 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:52:20 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:20 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135 1073741824 Nov 04 18:52:20 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:20 devstack sudo[93036]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5fceea15-a5ea-4d50-865d-4abc47049d1d tempest-ServersNegativeTestJSON-1622364679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-aa9a1d3a-5fbb-4432-8585-f25d43bcd5af" returned: 0 in 0.525s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5fceea15-a5ea-4d50-865d-4abc47049d1d tempest-ServersNegativeTestJSON-1622364679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-aa9a1d3a-5fbb-4432-8585-f25d43bcd5af {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:20 devstack sudo[93043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-aa9a1d3a-5fbb-4432-8585-f25d43bcd5af Nov 04 18:52:20 devstack sudo[93043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:21 devstack sudo[93043]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5fceea15-a5ea-4d50-865d-4abc47049d1d tempest-ServersNegativeTestJSON-1622364679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-aa9a1d3a-5fbb-4432-8585-f25d43bcd5af" returned: 0 in 0.329s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:21 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5fceea15-a5ea-4d50-865d-4abc47049d1d tempest-ServersNegativeTestJSON-1622364679 None] Lock "cinder-quobyte-aa9a1d3a-5fbb-4432-8585-f25d43bcd5af" released by "delete_volume" :: held 0.924s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:21 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-5fceea15-a5ea-4d50-865d-4abc47049d1d tempest-ServersNegativeTestJSON-1622364679 None] Created reservations ['539851dc-bbb0-4aa5-a822-ffd8cfdaa934', '79580564-4a91-4464-b451-e975706db44b', '36e68d53-67e3-4162-8e01-d5fe7f807c3d', '411573d8-683a-4f11-b2fb-3bbc3a10df89'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5fceea15-a5ea-4d50-865d-4abc47049d1d tempest-ServersNegativeTestJSON-1622364679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5fceea15-a5ea-4d50-865d-4abc47049d1d tempest-ServersNegativeTestJSON-1622364679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:21 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5fceea15-a5ea-4d50-865d-4abc47049d1d tempest-ServersNegativeTestJSON-1622364679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:21 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5fceea15-a5ea-4d50-865d-4abc47049d1d tempest-ServersNegativeTestJSON-1622364679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5fceea15-a5ea-4d50-865d-4abc47049d1d tempest-ServersNegativeTestJSON-1622364679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5fceea15-a5ea-4d50-865d-4abc47049d1d tempest-ServersNegativeTestJSON-1622364679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:21 devstack sudo[93050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:52:21 devstack sudo[93050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:21 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135 1073741824" returned: 0 in 0.619s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:21 devstack sudo[93052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135 Nov 04 18:52:21 devstack sudo[93052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:21 devstack sudo[93050]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5fceea15-a5ea-4d50-865d-4abc47049d1d tempest-ServersNegativeTestJSON-1622364679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.294s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:21 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-5fceea15-a5ea-4d50-865d-4abc47049d1d tempest-ServersNegativeTestJSON-1622364679 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:52:21 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-5fceea15-a5ea-4d50-865d-4abc47049d1d tempest-ServersNegativeTestJSON-1622364679 None] Deleted volume successfully. Nov 04 18:52:21 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5fceea15-a5ea-4d50-865d-4abc47049d1d tempest-ServersNegativeTestJSON-1622364679 None] Lock "cinder-aa9a1d3a-5fbb-4432-8585-f25d43bcd5af-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:21 devstack sudo[93052]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135" returned: 0 in 0.293s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:21 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:52:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33bd405f-75e6-4100-b665-4a00476ac941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25d17a30-37cd-4205-adf9-56fc91a8b135', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b392708-220a-4649-898f-faf02d6c892f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:21 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Volume volume-25d17a30-37cd-4205-adf9-56fc91a8b135 (25d17a30-37cd-4205-adf9-56fc91a8b135): created successfully Nov 04 18:52:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b392708-220a-4649-898f-faf02d6c892f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Flow 'volume_create_manager' (1b84ad71-b030-4dfe-ad15-334aa9d87670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:52:21 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-88734818-39f3-4008-9bb3-fd2b66987023 tempest-GroupSnapshotsTest-1933020210 None] Created volume successfully. Nov 04 18:52:22 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-bb4c12fa-499d-4dc9-9461-6fa847a04c4f tempest-ServersNegativeTestJSON-1622364679 None] Acquiring lock "cinder-4afc5c7b-3f57-436d-8f7d-d534dc992f75-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:22 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-bb4c12fa-499d-4dc9-9461-6fa847a04c4f tempest-ServersNegativeTestJSON-1622364679 None] Lock "cinder-4afc5c7b-3f57-436d-8f7d-d534dc992f75-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:22 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-bb4c12fa-499d-4dc9-9461-6fa847a04c4f tempest-ServersNegativeTestJSON-1622364679 None] Acquiring lock "cinder-quobyte-4afc5c7b-3f57-436d-8f7d-d534dc992f75" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:22 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-bb4c12fa-499d-4dc9-9461-6fa847a04c4f tempest-ServersNegativeTestJSON-1622364679 None] Lock "cinder-quobyte-4afc5c7b-3f57-436d-8f7d-d534dc992f75" acquired by "delete_volume" :: waited 0.022s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:22 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[471d1ffc-232e-4e8d-91de-581e9a17c1e6]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bb4c12fa-499d-4dc9-9461-6fa847a04c4f tempest-ServersNegativeTestJSON-1622364679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4afc5c7b-3f57-436d-8f7d-d534dc992f75 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:22 devstack sudo[93056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4afc5c7b-3f57-436d-8f7d-d534dc992f75 Nov 04 18:52:22 devstack sudo[93056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:22 devstack sudo[93056]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bb4c12fa-499d-4dc9-9461-6fa847a04c4f tempest-ServersNegativeTestJSON-1622364679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4afc5c7b-3f57-436d-8f7d-d534dc992f75" returned: 0 in 0.435s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bb4c12fa-499d-4dc9-9461-6fa847a04c4f tempest-ServersNegativeTestJSON-1622364679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4afc5c7b-3f57-436d-8f7d-d534dc992f75 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:22 devstack sudo[93061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4afc5c7b-3f57-436d-8f7d-d534dc992f75 Nov 04 18:52:22 devstack sudo[93061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:23 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-27228a42-4858-4315-b6ab-5077fbbe90b1 tempest-GroupSnapshotsTest-1933020210 None] Update group completed successfully. Nov 04 18:52:23 devstack sudo[93061]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bb4c12fa-499d-4dc9-9461-6fa847a04c4f tempest-ServersNegativeTestJSON-1622364679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4afc5c7b-3f57-436d-8f7d-d534dc992f75" returned: 0 in 0.355s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:23 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-bb4c12fa-499d-4dc9-9461-6fa847a04c4f tempest-ServersNegativeTestJSON-1622364679 None] Lock "cinder-quobyte-4afc5c7b-3f57-436d-8f7d-d534dc992f75" released by "delete_volume" :: held 0.857s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:23 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-bb4c12fa-499d-4dc9-9461-6fa847a04c4f tempest-ServersNegativeTestJSON-1622364679 None] Created reservations ['a6a97809-fdc1-4124-bda0-452acc654093', 'c342602c-1811-4a7f-844d-26aee532e0c0', '5774aba6-c275-4bee-be90-1e3862d0b251', '468cd2e7-0629-40b2-ace1-05abffb5d8cc'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bb4c12fa-499d-4dc9-9461-6fa847a04c4f tempest-ServersNegativeTestJSON-1622364679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bb4c12fa-499d-4dc9-9461-6fa847a04c4f tempest-ServersNegativeTestJSON-1622364679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:23 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bb4c12fa-499d-4dc9-9461-6fa847a04c4f tempest-ServersNegativeTestJSON-1622364679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:23 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bb4c12fa-499d-4dc9-9461-6fa847a04c4f tempest-ServersNegativeTestJSON-1622364679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bb4c12fa-499d-4dc9-9461-6fa847a04c4f tempest-ServersNegativeTestJSON-1622364679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bb4c12fa-499d-4dc9-9461-6fa847a04c4f tempest-ServersNegativeTestJSON-1622364679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:23 devstack sudo[93064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:52:23 devstack sudo[93064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:23 devstack sudo[93064]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bb4c12fa-499d-4dc9-9461-6fa847a04c4f tempest-ServersNegativeTestJSON-1622364679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.301s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:23 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-bb4c12fa-499d-4dc9-9461-6fa847a04c4f tempest-ServersNegativeTestJSON-1622364679 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:52:23 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-bb4c12fa-499d-4dc9-9461-6fa847a04c4f tempest-ServersNegativeTestJSON-1622364679 None] Deleted volume successfully. Nov 04 18:52:23 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-bb4c12fa-499d-4dc9-9461-6fa847a04c4f tempest-ServersNegativeTestJSON-1622364679 None] Lock "cinder-4afc5c7b-3f57-436d-8f7d-d534dc992f75-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:24 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-37a27ec0-bd75-4588-8479-c35ca5671d30 tempest-GroupSnapshotsTest-1933020210 None] Update group completed successfully. Nov 04 18:52:24 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:52:24 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Flow 'volume_create_manager' (b217849d-0ac0-4be4-9c73-3605be8c61cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:52:24 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (323bfb02-cadd-4052-9126-61a725c28948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:24 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (323bfb02-cadd-4052-9126-61a725c28948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-427856252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72687c70-1ffb-4542-b4c5-dd47f310204b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9db25085d9344b4da620bc7180814e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:52:25Z,use_quota=True,user_id='5a1af61bec414df8a48905ee3cd06c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:24 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4953f691-bc77-4370-aec1-218db039f87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:24 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4953f691-bc77-4370-aec1-218db039f87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:24 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39f83511-6e0e-4109-adeb-0893cfa7fef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:24 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39f83511-6e0e-4109-adeb-0893cfa7fef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72687c70-1ffb-4542-b4c5-dd47f310204b', 'volume_name': 'volume-72687c70-1ffb-4542-b4c5-dd47f310204b', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:24 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75bfe508-31b0-451c-83a8-2ae5a67c3c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:24 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75bfe508-31b0-451c-83a8-2ae5a67c3c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:24 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (146c76c5-d645-4691-a082-f50d95842b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:24 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Volume 72687c70-1ffb-4542-b4c5-dd47f310204b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72687c70-1ffb-4542-b4c5-dd47f310204b', 'volume_size': 1} Nov 04 18:52:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:24 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-427856252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72687c70-1ffb-4542-b4c5-dd47f310204b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9db25085d9344b4da620bc7180814e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:52:25Z,use_quota=True,user_id='5a1af61bec414df8a48905ee3cd06c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:52:24 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Creating volume 72687c70-1ffb-4542-b4c5-dd47f310204b {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:52:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:24 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:24 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:24 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:52:24 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:52:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:24 devstack sudo[93088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b 1073741824 Nov 04 18:52:24 devstack sudo[93088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:52:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:25 devstack sudo[93094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:52:25 devstack sudo[93094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:25 devstack sudo[93088]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b 1073741824" returned: 0 in 0.560s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:25 devstack sudo[93098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b Nov 04 18:52:25 devstack sudo[93098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:25 devstack sudo[93094]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.304s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:25 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:52:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager._thread_info {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:52:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread count: 28 {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:52:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread info: [<_MainThread(MainThread, started 130247852032128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:52:25 devstack sudo[93098]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:25 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-76b97e34-6b29-4314-8aca-68a1daa244e1 tempest-GroupSnapshotsTest-1933020210 None] Update group completed successfully. Nov 04 18:52:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b" returned: 0 in 0.376s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:52:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (146c76c5-d645-4691-a082-f50d95842b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72687c70-1ffb-4542-b4c5-dd47f310204b', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38960378-fe51-45a6-9a02-cef0ad4d1a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:25 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Volume volume-72687c70-1ffb-4542-b4c5-dd47f310204b (72687c70-1ffb-4542-b4c5-dd47f310204b): created successfully Nov 04 18:52:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38960378-fe51-45a6-9a02-cef0ad4d1a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Flow 'volume_create_manager' (b217849d-0ac0-4be4-9c73-3605be8c61cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:52:25 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-1265fad8-ed17-433c-9304-7b3f8cfb6cc3 tempest-SnapshotsActionsTest-538702046 None] Created volume successfully. Nov 04 18:52:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-95dac529-e57e-4e07-821d-fbf20b8099c7 tempest-SnapshotsActionsTest-538702046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-95dac529-e57e-4e07-821d-fbf20b8099c7 tempest-SnapshotsActionsTest-538702046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:27 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-95dac529-e57e-4e07-821d-fbf20b8099c7 tempest-SnapshotsActionsTest-538702046 None] Creating offline snapshot f289e43a-27d6-4da4-ade2-403ca4ea7765 of volume 72687c70-1ffb-4542-b4c5-dd47f310204b {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:52:27 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-0925dadd-c9dc-4c36-aa64-7741713772cb tempest-GroupSnapshotsTest-1933020210 None] Update group completed successfully. Nov 04 18:52:27 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[299c2cae-8f17-49cd-99a3-070401cbee16]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-95dac529-e57e-4e07-821d-fbf20b8099c7 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:27 devstack sudo[93104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b Nov 04 18:52:27 devstack sudo[93104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:27 devstack sudo[93104]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-95dac529-e57e-4e07-821d-fbf20b8099c7 tempest-SnapshotsActionsTest-538702046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b" returned: 0 in 0.428s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-95dac529-e57e-4e07-821d-fbf20b8099c7 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:27 devstack sudo[93109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 1G Nov 04 18:52:27 devstack sudo[93109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:28 devstack sudo[93109]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-95dac529-e57e-4e07-821d-fbf20b8099c7 tempest-SnapshotsActionsTest-538702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 1G" returned: 0 in 0.524s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-95dac529-e57e-4e07-821d-fbf20b8099c7 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72687c70-1ffb-4542-b4c5-dd47f310204b -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:28 devstack sudo[93115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72687c70-1ffb-4542-b4c5-dd47f310204b -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 Nov 04 18:52:28 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:28 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-95dac529-e57e-4e07-821d-fbf20b8099c7 tempest-SnapshotsActionsTest-538702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72687c70-1ffb-4542-b4c5-dd47f310204b -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765" returned: 0 in 0.429s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:28 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-95dac529-e57e-4e07-821d-fbf20b8099c7 tempest-SnapshotsActionsTest-538702046 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 is being set with open permissions: ugo+rw Nov 04 18:52:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-95dac529-e57e-4e07-821d-fbf20b8099c7 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:28 devstack sudo[93121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 Nov 04 18:52:28 devstack sudo[93121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:28 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] GroupSnapshot 00357896-4851-4d87-b40d-d79707b00a9b: creating. Nov 04 18:52:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] Group snapshot 00357896-4851-4d87-b40d-d79707b00a9b: creating. {{(pid=87119) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 04 18:52:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:28 devstack sudo[93121]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-95dac529-e57e-4e07-821d-fbf20b8099c7 tempest-SnapshotsActionsTest-538702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765" returned: 0 in 0.403s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-95dac529-e57e-4e07-821d-fbf20b8099c7 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:28 devstack sudo[93124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.info Nov 04 18:52:28 devstack sudo[93124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:29 devstack sudo[93124]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-95dac529-e57e-4e07-821d-fbf20b8099c7 tempest-SnapshotsActionsTest-538702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.info" returned: 0 in 0.308s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:29 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-95dac529-e57e-4e07-821d-fbf20b8099c7 tempest-SnapshotsActionsTest-538702046 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.info is being set with open permissions: ugo+rw Nov 04 18:52:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-95dac529-e57e-4e07-821d-fbf20b8099c7 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:29 devstack sudo[93127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.info Nov 04 18:52:29 devstack sudo[93127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:29 devstack sudo[93127]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-95dac529-e57e-4e07-821d-fbf20b8099c7 tempest-SnapshotsActionsTest-538702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.info" returned: 0 in 0.405s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-95dac529-e57e-4e07-821d-fbf20b8099c7 tempest-SnapshotsActionsTest-538702046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.619s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.798s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] Creating offline snapshot 209fd1ac-04be-42e8-bbaf-a0a0c1fadcc7 of volume f8563220-2d68-49c4-860f-ac6d63a65ee5 {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:52:29 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-95dac529-e57e-4e07-821d-fbf20b8099c7 tempest-SnapshotsActionsTest-538702046 None] Create snapshot completed successfully Nov 04 18:52:29 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0a90b3-e2b4-428e-982f-2622ecfd519b]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:29 devstack sudo[93131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5 Nov 04 18:52:29 devstack sudo[93131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:30 devstack sudo[93131]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5" returned: 0 in 0.470s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5.209fd1ac-04be-42e8-bbaf-a0a0c1fadcc7 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:30 devstack sudo[93136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5.209fd1ac-04be-42e8-bbaf-a0a0c1fadcc7 1G Nov 04 18:52:30 devstack sudo[93136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:30 devstack sudo[93136]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5.209fd1ac-04be-42e8-bbaf-a0a0c1fadcc7 1G" returned: 0 in 0.693s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8563220-2d68-49c4-860f-ac6d63a65ee5 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5.209fd1ac-04be-42e8-bbaf-a0a0c1fadcc7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e5d3bcf5-7ff1-4417-889a-bfdb143ab630 tempest-SnapshotsActionsTest-538702046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:30 devstack sudo[93143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8563220-2d68-49c4-860f-ac6d63a65ee5 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5.209fd1ac-04be-42e8-bbaf-a0a0c1fadcc7 Nov 04 18:52:30 devstack sudo[93143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:31 devstack sudo[93143]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8563220-2d68-49c4-860f-ac6d63a65ee5 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5.209fd1ac-04be-42e8-bbaf-a0a0c1fadcc7" returned: 0 in 0.386s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:31 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5.209fd1ac-04be-42e8-bbaf-a0a0c1fadcc7 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 18:52:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5.209fd1ac-04be-42e8-bbaf-a0a0c1fadcc7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:31 devstack sudo[93148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5.209fd1ac-04be-42e8-bbaf-a0a0c1fadcc7 Nov 04 18:52:31 devstack sudo[93148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:31 devstack sudo[93148]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5.209fd1ac-04be-42e8-bbaf-a0a0c1fadcc7" returned: 0 in 0.316s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:31 devstack sudo[93151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5.info Nov 04 18:52:31 devstack sudo[93151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:31 devstack sudo[93151]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5.info" returned: 0 in 0.314s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:31 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 18:52:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:32 devstack sudo[93154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5.info Nov 04 18:52:32 devstack sudo[93154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:32 devstack sudo[93154]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5.info" returned: 0 in 0.329s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.665s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] Creating offline snapshot e3aae7cf-4a83-4c15-a812-d1f778759fc4 of volume 25d17a30-37cd-4205-adf9-56fc91a8b135 {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:52:32 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5b8028-b1e0-4fab-931f-2a0d64640ee4]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:32 devstack sudo[93157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135 Nov 04 18:52:32 devstack sudo[93157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:32 devstack sudo[93157]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135" returned: 0 in 0.454s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135.e3aae7cf-4a83-4c15-a812-d1f778759fc4 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:32 devstack sudo[93162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135.e3aae7cf-4a83-4c15-a812-d1f778759fc4 1G Nov 04 18:52:32 devstack sudo[93162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:33 devstack sudo[93162]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135.e3aae7cf-4a83-4c15-a812-d1f778759fc4 1G" returned: 0 in 0.521s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25d17a30-37cd-4205-adf9-56fc91a8b135 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135.e3aae7cf-4a83-4c15-a812-d1f778759fc4 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:33 devstack sudo[93168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25d17a30-37cd-4205-adf9-56fc91a8b135 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135.e3aae7cf-4a83-4c15-a812-d1f778759fc4 Nov 04 18:52:33 devstack sudo[93168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:33 devstack sudo[93168]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25d17a30-37cd-4205-adf9-56fc91a8b135 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135.e3aae7cf-4a83-4c15-a812-d1f778759fc4" returned: 0 in 0.542s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:33 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135.e3aae7cf-4a83-4c15-a812-d1f778759fc4 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 18:52:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135.e3aae7cf-4a83-4c15-a812-d1f778759fc4 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:33 devstack sudo[93174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135.e3aae7cf-4a83-4c15-a812-d1f778759fc4 Nov 04 18:52:33 devstack sudo[93174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:34 devstack sudo[93174]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135.e3aae7cf-4a83-4c15-a812-d1f778759fc4" returned: 0 in 0.326s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:34 devstack sudo[93177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135.info Nov 04 18:52:34 devstack sudo[93177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:34 devstack sudo[93177]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135.info" returned: 0 in 0.349s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:34 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 18:52:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:34 devstack sudo[93180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135.info Nov 04 18:52:34 devstack sudo[93180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:34 devstack sudo[93180]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135.info" returned: 0 in 0.346s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.665s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e5d3bcf5-7ff1-4417-889a-bfdb143ab630 tempest-SnapshotsActionsTest-538702046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.050s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:35 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-e5d3bcf5-7ff1-4417-889a-bfdb143ab630 tempest-SnapshotsActionsTest-538702046 None] Creating offline snapshot 50f71119-5259-436c-bf64-eddfb6fa9866 of volume 72687c70-1ffb-4542-b4c5-dd47f310204b {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:52:35 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f39d991-d60d-482d-a3e1-60f22d24b5d0]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5d3bcf5-7ff1-4417-889a-bfdb143ab630 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:35 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-c940264f-6815-48ea-b646-d5c01947e1e3 tempest-GroupSnapshotsTest-1933020210 None] group_snapshot 00357896-4851-4d87-b40d-d79707b00a9b: created successfully Nov 04 18:52:35 devstack sudo[93190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 Nov 04 18:52:35 devstack sudo[93190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:35 devstack sudo[93190]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5d3bcf5-7ff1-4417-889a-bfdb143ab630 tempest-SnapshotsActionsTest-538702046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765" returned: 0 in 0.446s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:35 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-e5d3bcf5-7ff1-4417-889a-bfdb143ab630 tempest-SnapshotsActionsTest-538702046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72687c70-1ffb-4542-b4c5-dd47f310204b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:52:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5d3bcf5-7ff1-4417-889a-bfdb143ab630 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.50f71119-5259-436c-bf64-eddfb6fa9866 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:35 devstack sudo[93196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.50f71119-5259-436c-bf64-eddfb6fa9866 1G Nov 04 18:52:35 devstack sudo[93196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:36 devstack sudo[93196]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5d3bcf5-7ff1-4417-889a-bfdb143ab630 tempest-SnapshotsActionsTest-538702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.50f71119-5259-436c-bf64-eddfb6fa9866 1G" returned: 0 in 0.556s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5d3bcf5-7ff1-4417-889a-bfdb143ab630 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.50f71119-5259-436c-bf64-eddfb6fa9866 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:36 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.50f71119-5259-436c-bf64-eddfb6fa9866 Nov 04 18:52:36 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:36 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] group_snapshot 00357896-4851-4d87-b40d-d79707b00a9b: deleting Nov 04 18:52:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] group_snapshot 00357896-4851-4d87-b40d-d79707b00a9b: deleting {{(pid=87119) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 04 18:52:36 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "cinder-quobyte-f8563220-2d68-49c4-860f-ac6d63a65ee5" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:36 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-f8563220-2d68-49c4-860f-ac6d63a65ee5" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:36 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "cinder-quobyte-209fd1ac-04be-42e8-bbaf-a0a0c1fadcc7" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:36 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-209fd1ac-04be-42e8-bbaf-a0a0c1fadcc7" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:36 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] Deleting offline snapshot 209fd1ac-04be-42e8-bbaf-a0a0c1fadcc7 of volume f8563220-2d68-49c4-860f-ac6d63a65ee5 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:52:36 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] snapshot_file for this snap is: volume-f8563220-2d68-49c4-860f-ac6d63a65ee5.209fd1ac-04be-42e8-bbaf-a0a0c1fadcc7 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:52:36 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5d3bcf5-7ff1-4417-889a-bfdb143ab630 tempest-SnapshotsActionsTest-538702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.50f71119-5259-436c-bf64-eddfb6fa9866" returned: 0 in 0.523s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:36 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-e5d3bcf5-7ff1-4417-889a-bfdb143ab630 tempest-SnapshotsActionsTest-538702046 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.50f71119-5259-436c-bf64-eddfb6fa9866 is being set with open permissions: ugo+rw Nov 04 18:52:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5d3bcf5-7ff1-4417-889a-bfdb143ab630 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.50f71119-5259-436c-bf64-eddfb6fa9866 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:36 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[485583e3-e538-4f65-895a-26b3b5ba359a]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5.209fd1ac-04be-42e8-bbaf-a0a0c1fadcc7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:36 devstack sudo[93209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.50f71119-5259-436c-bf64-eddfb6fa9866 Nov 04 18:52:36 devstack sudo[93209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:36 devstack sudo[93210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5.209fd1ac-04be-42e8-bbaf-a0a0c1fadcc7 Nov 04 18:52:36 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:37 devstack sudo[93209]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5d3bcf5-7ff1-4417-889a-bfdb143ab630 tempest-SnapshotsActionsTest-538702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.50f71119-5259-436c-bf64-eddfb6fa9866" returned: 0 in 0.368s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e5d3bcf5-7ff1-4417-889a-bfdb143ab630 tempest-SnapshotsActionsTest-538702046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.131s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:37 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e5d3bcf5-7ff1-4417-889a-bfdb143ab630 tempest-SnapshotsActionsTest-538702046 None] Create snapshot completed successfully Nov 04 18:52:37 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5.209fd1ac-04be-42e8-bbaf-a0a0c1fadcc7" returned: 0 in 0.516s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8563220-2d68-49c4-860f-ac6d63a65ee5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:52:37 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c9630d-954f-4f3a-b131-10f4cb0e4906]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:37 devstack sudo[93218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5 Nov 04 18:52:37 devstack sudo[93218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:37 devstack sudo[93218]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5" returned: 0 in 0.470s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5.209fd1ac-04be-42e8-bbaf-a0a0c1fadcc7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:37 devstack sudo[93223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5.209fd1ac-04be-42e8-bbaf-a0a0c1fadcc7 Nov 04 18:52:37 devstack sudo[93223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:38 devstack sudo[93223]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5.209fd1ac-04be-42e8-bbaf-a0a0c1fadcc7" returned: 0 in 0.489s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5.209fd1ac-04be-42e8-bbaf-a0a0c1fadcc7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:38 devstack sudo[93231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5.209fd1ac-04be-42e8-bbaf-a0a0c1fadcc7 Nov 04 18:52:38 devstack sudo[93231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-06dbacbb-0734-4c4e-ad35-12df071a6207 tempest-SnapshotsActionsTest-678415562 None] Acquiring lock "cinder-50f71119-5259-436c-bf64-eddfb6fa9866-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-06dbacbb-0734-4c4e-ad35-12df071a6207 tempest-SnapshotsActionsTest-678415562 None] Lock "cinder-50f71119-5259-436c-bf64-eddfb6fa9866-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-06dbacbb-0734-4c4e-ad35-12df071a6207 tempest-SnapshotsActionsTest-678415562 None] Acquiring lock "cinder-quobyte-72687c70-1ffb-4542-b4c5-dd47f310204b" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-06dbacbb-0734-4c4e-ad35-12df071a6207 tempest-SnapshotsActionsTest-678415562 None] Lock "cinder-quobyte-72687c70-1ffb-4542-b4c5-dd47f310204b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-06dbacbb-0734-4c4e-ad35-12df071a6207 tempest-SnapshotsActionsTest-678415562 None] Acquiring lock "cinder-quobyte-50f71119-5259-436c-bf64-eddfb6fa9866" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-06dbacbb-0734-4c4e-ad35-12df071a6207 tempest-SnapshotsActionsTest-678415562 None] Lock "cinder-quobyte-50f71119-5259-436c-bf64-eddfb6fa9866" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-06dbacbb-0734-4c4e-ad35-12df071a6207 tempest-SnapshotsActionsTest-678415562 None] Deleting offline snapshot 50f71119-5259-436c-bf64-eddfb6fa9866 of volume 72687c70-1ffb-4542-b4c5-dd47f310204b {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:52:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-06dbacbb-0734-4c4e-ad35-12df071a6207 tempest-SnapshotsActionsTest-678415562 None] snapshot_file for this snap is: volume-72687c70-1ffb-4542-b4c5-dd47f310204b.50f71119-5259-436c-bf64-eddfb6fa9866 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:52:38 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fcf311-9ed8-41c2-bfff-3e033110b17c]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-06dbacbb-0734-4c4e-ad35-12df071a6207 tempest-SnapshotsActionsTest-678415562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.50f71119-5259-436c-bf64-eddfb6fa9866 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:38 devstack sudo[93231]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5.209fd1ac-04be-42e8-bbaf-a0a0c1fadcc7" returned: 0 in 0.432s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-209fd1ac-04be-42e8-bbaf-a0a0c1fadcc7" released by "_delete_snapshot" :: held 2.071s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-f8563220-2d68-49c4-860f-ac6d63a65ee5" released by "delete_snapshot" :: held 2.117s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "cinder-quobyte-25d17a30-37cd-4205-adf9-56fc91a8b135" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:38 devstack sudo[93234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.50f71119-5259-436c-bf64-eddfb6fa9866 Nov 04 18:52:38 devstack sudo[93234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-25d17a30-37cd-4205-adf9-56fc91a8b135" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "cinder-quobyte-e3aae7cf-4a83-4c15-a812-d1f778759fc4" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-e3aae7cf-4a83-4c15-a812-d1f778759fc4" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] Deleting offline snapshot e3aae7cf-4a83-4c15-a812-d1f778759fc4 of volume 25d17a30-37cd-4205-adf9-56fc91a8b135 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:52:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] snapshot_file for this snap is: volume-25d17a30-37cd-4205-adf9-56fc91a8b135.e3aae7cf-4a83-4c15-a812-d1f778759fc4 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:52:38 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5581682-2225-4b1b-a805-e0c89c75785e]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135.e3aae7cf-4a83-4c15-a812-d1f778759fc4 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:39 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135.e3aae7cf-4a83-4c15-a812-d1f778759fc4 Nov 04 18:52:39 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:39 devstack sudo[93234]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-06dbacbb-0734-4c4e-ad35-12df071a6207 tempest-SnapshotsActionsTest-678415562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.50f71119-5259-436c-bf64-eddfb6fa9866" returned: 0 in 0.500s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:39 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-06dbacbb-0734-4c4e-ad35-12df071a6207 tempest-SnapshotsActionsTest-678415562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72687c70-1ffb-4542-b4c5-dd47f310204b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:52:39 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5034557b-2876-4fcd-8ea3-2538ec7cae41]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-06dbacbb-0734-4c4e-ad35-12df071a6207 tempest-SnapshotsActionsTest-678415562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:39 devstack sudo[93242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 Nov 04 18:52:39 devstack sudo[93242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:39 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135.e3aae7cf-4a83-4c15-a812-d1f778759fc4" returned: 0 in 0.555s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:39 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25d17a30-37cd-4205-adf9-56fc91a8b135(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:52:39 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[739d3737-0588-4a55-a0af-6679d20f02b7]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:39 devstack sudo[93248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135 Nov 04 18:52:39 devstack sudo[93248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:39 devstack sudo[93242]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-06dbacbb-0734-4c4e-ad35-12df071a6207 tempest-SnapshotsActionsTest-678415562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765" returned: 0 in 0.586s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:39 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-06dbacbb-0734-4c4e-ad35-12df071a6207 tempest-SnapshotsActionsTest-678415562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72687c70-1ffb-4542-b4c5-dd47f310204b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:52:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-06dbacbb-0734-4c4e-ad35-12df071a6207 tempest-SnapshotsActionsTest-678415562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.50f71119-5259-436c-bf64-eddfb6fa9866 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:39 devstack sudo[93253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.50f71119-5259-436c-bf64-eddfb6fa9866 Nov 04 18:52:39 devstack sudo[93253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:40 devstack sudo[93248]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135" returned: 0 in 0.586s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135.e3aae7cf-4a83-4c15-a812-d1f778759fc4 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:40 devstack sudo[93263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135.e3aae7cf-4a83-4c15-a812-d1f778759fc4 Nov 04 18:52:40 devstack sudo[93263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:40 devstack sudo[93253]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-06dbacbb-0734-4c4e-ad35-12df071a6207 tempest-SnapshotsActionsTest-678415562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.50f71119-5259-436c-bf64-eddfb6fa9866" returned: 0 in 0.553s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-06dbacbb-0734-4c4e-ad35-12df071a6207 tempest-SnapshotsActionsTest-678415562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.50f71119-5259-436c-bf64-eddfb6fa9866 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:40 devstack sudo[93275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.50f71119-5259-436c-bf64-eddfb6fa9866 Nov 04 18:52:40 devstack sudo[93275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:40 devstack sudo[93263]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135.e3aae7cf-4a83-4c15-a812-d1f778759fc4" returned: 0 in 0.567s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135.e3aae7cf-4a83-4c15-a812-d1f778759fc4 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:40 devstack sudo[93290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135.e3aae7cf-4a83-4c15-a812-d1f778759fc4 Nov 04 18:52:40 devstack sudo[93290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:40 devstack sudo[93275]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-06dbacbb-0734-4c4e-ad35-12df071a6207 tempest-SnapshotsActionsTest-678415562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.50f71119-5259-436c-bf64-eddfb6fa9866" returned: 0 in 0.478s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-06dbacbb-0734-4c4e-ad35-12df071a6207 tempest-SnapshotsActionsTest-678415562 None] Lock "cinder-quobyte-50f71119-5259-436c-bf64-eddfb6fa9866" released by "_delete_snapshot" :: held 2.259s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-06dbacbb-0734-4c4e-ad35-12df071a6207 tempest-SnapshotsActionsTest-678415562 None] Lock "cinder-quobyte-72687c70-1ffb-4542-b4c5-dd47f310204b" released by "delete_snapshot" :: held 2.305s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:40 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-06dbacbb-0734-4c4e-ad35-12df071a6207 tempest-SnapshotsActionsTest-678415562 None] Created reservations ['c610b30d-d43a-4480-9586-e93aa2f3297e', 'd4245aa4-ed18-4e53-a082-cc5890862594', 'd48a984a-0278-49f3-816a-096b284067c6', '57f2f16d-3d46-4952-bc36-6bd30ef13c89'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:41 devstack sudo[93290]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135.e3aae7cf-4a83-4c15-a812-d1f778759fc4" returned: 0 in 0.359s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:41 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-e3aae7cf-4a83-4c15-a812-d1f778759fc4" released by "_delete_snapshot" :: held 2.231s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:41 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-25d17a30-37cd-4205-adf9-56fc91a8b135" released by "delete_snapshot" :: held 2.271s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:41 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-06dbacbb-0734-4c4e-ad35-12df071a6207 tempest-SnapshotsActionsTest-678415562 None] Delete snapshot completed successfully. Nov 04 18:52:41 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-06dbacbb-0734-4c4e-ad35-12df071a6207 tempest-SnapshotsActionsTest-678415562 None] Lock "cinder-50f71119-5259-436c-bf64-eddfb6fa9866-delete_snapshot" released by "delete_snapshot" :: held 2.592s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:41 devstack cinder-volume[87119]: WARNING cinder.quota [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2060566788 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2060566788, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:52:41 devstack cinder-volume[87119]: WARNING cinder.quota [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2060566788 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2060566788, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:52:41 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] Created reservations ['373d2401-fa3c-46a5-9ab7-9c274c4555a6', '45f61d97-e026-4b54-a7f0-bfb742aca137', '73a73b55-bf58-40b7-8f00-d097bf0889e9', '22e16b4b-84b9-403a-834b-607b32832825'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:41 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] Created reservations ['e83ca933-fd42-49d3-b6e9-f30997cf1136', '8b371c4a-e4c2-46b4-b37f-f0d49624329b', '5a5c237e-b924-46d4-893c-89f4143f44f2', '040624f3-9f59-49bc-9186-9f488137a828'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:41 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-c17ec67d-2ce2-400b-a571-25b060e24cd1 tempest-GroupSnapshotsTest-1933020210 None] group_snapshot 00357896-4851-4d87-b40d-d79707b00a9b: deleted successfully Nov 04 18:52:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-44fe3e4c-c85b-4742-bdf9-01ccae84cde2 tempest-SnapshotsActionsTest-538702046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-44fe3e4c-c85b-4742-bdf9-01ccae84cde2 tempest-SnapshotsActionsTest-538702046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:42 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-44fe3e4c-c85b-4742-bdf9-01ccae84cde2 tempest-SnapshotsActionsTest-538702046 None] Creating offline snapshot e03e3472-789e-4eb0-b9f0-49d330e7d1f8 of volume 72687c70-1ffb-4542-b4c5-dd47f310204b {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:52:42 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[97130123-9a28-44fc-b802-1729ad1765c9]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-44fe3e4c-c85b-4742-bdf9-01ccae84cde2 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:42 devstack sudo[93330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 Nov 04 18:52:42 devstack sudo[93330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-66ea80c3-7c59-4907-a520-76a6cb3ccc1b tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "cinder-quobyte-25d17a30-37cd-4205-adf9-56fc91a8b135" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-66ea80c3-7c59-4907-a520-76a6cb3ccc1b tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-25d17a30-37cd-4205-adf9-56fc91a8b135" acquired by "delete_volume" :: waited 0.026s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:42 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[11568b0c-7e1d-431f-8766-acd674697d89]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-66ea80c3-7c59-4907-a520-76a6cb3ccc1b tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:42 devstack sudo[93330]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-44fe3e4c-c85b-4742-bdf9-01ccae84cde2 tempest-SnapshotsActionsTest-538702046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765" returned: 0 in 0.563s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:42 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-44fe3e4c-c85b-4742-bdf9-01ccae84cde2 tempest-SnapshotsActionsTest-538702046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72687c70-1ffb-4542-b4c5-dd47f310204b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:52:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-44fe3e4c-c85b-4742-bdf9-01ccae84cde2 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.e03e3472-789e-4eb0-b9f0-49d330e7d1f8 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:42 devstack sudo[93337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.e03e3472-789e-4eb0-b9f0-49d330e7d1f8 1G Nov 04 18:52:42 devstack sudo[93337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:42 devstack sudo[93336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135 Nov 04 18:52:42 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:43 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-66ea80c3-7c59-4907-a520-76a6cb3ccc1b tempest-GroupSnapshotsTest-1933020210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135" returned: 0 in 0.485s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-66ea80c3-7c59-4907-a520-76a6cb3ccc1b tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:43 devstack sudo[93347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135 Nov 04 18:52:43 devstack sudo[93347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:43 devstack sudo[93337]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-44fe3e4c-c85b-4742-bdf9-01ccae84cde2 tempest-SnapshotsActionsTest-538702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.e03e3472-789e-4eb0-b9f0-49d330e7d1f8 1G" returned: 0 in 0.678s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-44fe3e4c-c85b-4742-bdf9-01ccae84cde2 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.e03e3472-789e-4eb0-b9f0-49d330e7d1f8 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:43 devstack sudo[93350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.e03e3472-789e-4eb0-b9f0-49d330e7d1f8 Nov 04 18:52:43 devstack sudo[93350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:43 devstack sudo[93347]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-66ea80c3-7c59-4907-a520-76a6cb3ccc1b tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-25d17a30-37cd-4205-adf9-56fc91a8b135" returned: 0 in 0.338s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-66ea80c3-7c59-4907-a520-76a6cb3ccc1b tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-25d17a30-37cd-4205-adf9-56fc91a8b135" released by "delete_volume" :: held 0.920s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-66ea80c3-7c59-4907-a520-76a6cb3ccc1b tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "cinder-quobyte-f8563220-2d68-49c4-860f-ac6d63a65ee5" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-66ea80c3-7c59-4907-a520-76a6cb3ccc1b tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-f8563220-2d68-49c4-860f-ac6d63a65ee5" acquired by "delete_volume" :: waited 0.020s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:43 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a0cf2d-fa28-4289-95a4-8ad5266e5766]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-66ea80c3-7c59-4907-a520-76a6cb3ccc1b tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:43 devstack sudo[93353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5 Nov 04 18:52:43 devstack sudo[93353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:43 devstack sudo[93350]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-44fe3e4c-c85b-4742-bdf9-01ccae84cde2 tempest-SnapshotsActionsTest-538702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.e03e3472-789e-4eb0-b9f0-49d330e7d1f8" returned: 0 in 0.342s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:43 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-44fe3e4c-c85b-4742-bdf9-01ccae84cde2 tempest-SnapshotsActionsTest-538702046 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.e03e3472-789e-4eb0-b9f0-49d330e7d1f8 is being set with open permissions: ugo+rw Nov 04 18:52:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-44fe3e4c-c85b-4742-bdf9-01ccae84cde2 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.e03e3472-789e-4eb0-b9f0-49d330e7d1f8 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:43 devstack sudo[93358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.e03e3472-789e-4eb0-b9f0-49d330e7d1f8 Nov 04 18:52:43 devstack sudo[93358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:44 devstack sudo[93358]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-44fe3e4c-c85b-4742-bdf9-01ccae84cde2 tempest-SnapshotsActionsTest-538702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.e03e3472-789e-4eb0-b9f0-49d330e7d1f8" returned: 0 in 0.514s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:44 devstack sudo[93353]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-44fe3e4c-c85b-4742-bdf9-01ccae84cde2 tempest-SnapshotsActionsTest-538702046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.317s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-66ea80c3-7c59-4907-a520-76a6cb3ccc1b tempest-GroupSnapshotsTest-1933020210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5" returned: 0 in 0.759s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-66ea80c3-7c59-4907-a520-76a6cb3ccc1b tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:44 devstack sudo[93404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5 Nov 04 18:52:44 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:44 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-44fe3e4c-c85b-4742-bdf9-01ccae84cde2 tempest-SnapshotsActionsTest-538702046 None] Create snapshot completed successfully Nov 04 18:52:45 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-66ea80c3-7c59-4907-a520-76a6cb3ccc1b tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f8563220-2d68-49c4-860f-ac6d63a65ee5" returned: 0 in 0.678s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-66ea80c3-7c59-4907-a520-76a6cb3ccc1b tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-f8563220-2d68-49c4-860f-ac6d63a65ee5" released by "delete_volume" :: held 1.531s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:45 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-66ea80c3-7c59-4907-a520-76a6cb3ccc1b tempest-GroupSnapshotsTest-1933020210 None] Created reservations ['c7235c1c-9812-4540-ac15-352cda441316'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:45 devstack cinder-volume[87119]: WARNING cinder.quota [None req-66ea80c3-7c59-4907-a520-76a6cb3ccc1b tempest-GroupSnapshotsTest-1933020210 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2060566788 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2060566788, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:52:45 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-66ea80c3-7c59-4907-a520-76a6cb3ccc1b tempest-GroupSnapshotsTest-1933020210 None] Created reservations ['d9139cae-0b9e-4261-9ce9-e60313ceefbd', 'e4ad664e-1938-4176-9a11-e851dec09c07', '7949edb0-1e8a-4e0d-bca7-aa4c310385a1', 'fe45c8c7-18f7-4fa3-ba2e-f5f6c1cdfb2d'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:45 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-66ea80c3-7c59-4907-a520-76a6cb3ccc1b tempest-GroupSnapshotsTest-1933020210 None] Created reservations ['9c64f870-b785-41e7-b237-e4d04afccb83', '23182371-6a10-40a6-aee3-efa02914d6f5', 'c3b94782-fe6c-497b-ace8-202d759a8b11', '4be99800-d1a9-4bdd-afb7-f0ca3f7aa64a'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-58ccf763-f603-4959-bd6a-bb4049f5faf1 tempest-SnapshotsActionsTest-678415562 None] Acquiring lock "cinder-e03e3472-789e-4eb0-b9f0-49d330e7d1f8-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-58ccf763-f603-4959-bd6a-bb4049f5faf1 tempest-SnapshotsActionsTest-678415562 None] Lock "cinder-e03e3472-789e-4eb0-b9f0-49d330e7d1f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-58ccf763-f603-4959-bd6a-bb4049f5faf1 tempest-SnapshotsActionsTest-678415562 None] Acquiring lock "cinder-quobyte-72687c70-1ffb-4542-b4c5-dd47f310204b" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-58ccf763-f603-4959-bd6a-bb4049f5faf1 tempest-SnapshotsActionsTest-678415562 None] Lock "cinder-quobyte-72687c70-1ffb-4542-b4c5-dd47f310204b" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-58ccf763-f603-4959-bd6a-bb4049f5faf1 tempest-SnapshotsActionsTest-678415562 None] Acquiring lock "cinder-quobyte-e03e3472-789e-4eb0-b9f0-49d330e7d1f8" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-58ccf763-f603-4959-bd6a-bb4049f5faf1 tempest-SnapshotsActionsTest-678415562 None] Lock "cinder-quobyte-e03e3472-789e-4eb0-b9f0-49d330e7d1f8" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-58ccf763-f603-4959-bd6a-bb4049f5faf1 tempest-SnapshotsActionsTest-678415562 None] Deleting offline snapshot e03e3472-789e-4eb0-b9f0-49d330e7d1f8 of volume 72687c70-1ffb-4542-b4c5-dd47f310204b {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:52:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-58ccf763-f603-4959-bd6a-bb4049f5faf1 tempest-SnapshotsActionsTest-678415562 None] snapshot_file for this snap is: volume-72687c70-1ffb-4542-b4c5-dd47f310204b.e03e3472-789e-4eb0-b9f0-49d330e7d1f8 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:52:45 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e323b4dc-cd48-43c5-aeaf-da81b9fac57a]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-58ccf763-f603-4959-bd6a-bb4049f5faf1 tempest-SnapshotsActionsTest-678415562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.e03e3472-789e-4eb0-b9f0-49d330e7d1f8 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-66ea80c3-7c59-4907-a520-76a6cb3ccc1b tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-66ea80c3-7c59-4907-a520-76a6cb3ccc1b tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-66ea80c3-7c59-4907-a520-76a6cb3ccc1b tempest-GroupSnapshotsTest-1933020210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-66ea80c3-7c59-4907-a520-76a6cb3ccc1b tempest-GroupSnapshotsTest-1933020210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-66ea80c3-7c59-4907-a520-76a6cb3ccc1b tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-66ea80c3-7c59-4907-a520-76a6cb3ccc1b tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:46 devstack sudo[93438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:52:46 devstack sudo[93438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:46 devstack sudo[93435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.e03e3472-789e-4eb0-b9f0-49d330e7d1f8 Nov 04 18:52:46 devstack sudo[93435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:46 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-42dd0b75-9443-42ed-80b0-18c7c1cdfa8e tempest-GroupsV320Test-1836703843 None] Group tempest-GroupsV320Test-Group-59181680: creating Nov 04 18:52:46 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-42dd0b75-9443-42ed-80b0-18c7c1cdfa8e tempest-GroupsV320Test-1836703843 None] Group tempest-GroupsV320Test-Group-59181680: created successfully Nov 04 18:52:46 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-42dd0b75-9443-42ed-80b0-18c7c1cdfa8e tempest-GroupsV320Test-1836703843 None] Create group completed successfully. Nov 04 18:52:46 devstack sudo[93438]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-66ea80c3-7c59-4907-a520-76a6cb3ccc1b tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.415s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:46 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-66ea80c3-7c59-4907-a520-76a6cb3ccc1b tempest-GroupSnapshotsTest-1933020210 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:52:46 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-66ea80c3-7c59-4907-a520-76a6cb3ccc1b tempest-GroupSnapshotsTest-1933020210 None] Delete group completed successfully. Nov 04 18:52:46 devstack sudo[93435]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-58ccf763-f603-4959-bd6a-bb4049f5faf1 tempest-SnapshotsActionsTest-678415562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.e03e3472-789e-4eb0-b9f0-49d330e7d1f8" returned: 0 in 0.649s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-58ccf763-f603-4959-bd6a-bb4049f5faf1 tempest-SnapshotsActionsTest-678415562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72687c70-1ffb-4542-b4c5-dd47f310204b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:52:46 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffaed04-972e-4410-91bb-57e05527c3f8]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-58ccf763-f603-4959-bd6a-bb4049f5faf1 tempest-SnapshotsActionsTest-678415562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:46 devstack sudo[93445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 Nov 04 18:52:46 devstack sudo[93445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:47 devstack sudo[93445]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-58ccf763-f603-4959-bd6a-bb4049f5faf1 tempest-SnapshotsActionsTest-678415562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765" returned: 0 in 0.503s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-58ccf763-f603-4959-bd6a-bb4049f5faf1 tempest-SnapshotsActionsTest-678415562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72687c70-1ffb-4542-b4c5-dd47f310204b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:52:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-58ccf763-f603-4959-bd6a-bb4049f5faf1 tempest-SnapshotsActionsTest-678415562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.e03e3472-789e-4eb0-b9f0-49d330e7d1f8 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:47 devstack sudo[93452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.e03e3472-789e-4eb0-b9f0-49d330e7d1f8 Nov 04 18:52:47 devstack sudo[93452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:47 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-6a7d43b2-6edc-4c96-8ff2-28af87a11ced tempest-GroupSnapshotsTest-1933020210 None] Group tempest-GroupSnapshotsTest-Group-1445559888: creating Nov 04 18:52:47 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-6a7d43b2-6edc-4c96-8ff2-28af87a11ced tempest-GroupSnapshotsTest-1933020210 None] Group tempest-GroupSnapshotsTest-Group-1445559888: created successfully Nov 04 18:52:47 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-6a7d43b2-6edc-4c96-8ff2-28af87a11ced tempest-GroupSnapshotsTest-1933020210 None] Create group completed successfully. Nov 04 18:52:47 devstack sudo[93452]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-58ccf763-f603-4959-bd6a-bb4049f5faf1 tempest-SnapshotsActionsTest-678415562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.e03e3472-789e-4eb0-b9f0-49d330e7d1f8" returned: 0 in 0.493s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-58ccf763-f603-4959-bd6a-bb4049f5faf1 tempest-SnapshotsActionsTest-678415562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.e03e3472-789e-4eb0-b9f0-49d330e7d1f8 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:47 devstack sudo[93458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.e03e3472-789e-4eb0-b9f0-49d330e7d1f8 Nov 04 18:52:47 devstack sudo[93458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:47 devstack sudo[93458]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-58ccf763-f603-4959-bd6a-bb4049f5faf1 tempest-SnapshotsActionsTest-678415562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.e03e3472-789e-4eb0-b9f0-49d330e7d1f8" returned: 0 in 0.311s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:47 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-e14a155f-df2a-464b-92d8-1d8243b38468 tempest-GroupsV320Test-1836703843 None] Created reservations ['40f353ae-5906-41f4-89e9-1efe09b5b0ae'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:47 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-58ccf763-f603-4959-bd6a-bb4049f5faf1 tempest-SnapshotsActionsTest-678415562 None] Lock "cinder-quobyte-e03e3472-789e-4eb0-b9f0-49d330e7d1f8" released by "_delete_snapshot" :: held 2.090s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:47 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-58ccf763-f603-4959-bd6a-bb4049f5faf1 tempest-SnapshotsActionsTest-678415562 None] Lock "cinder-quobyte-72687c70-1ffb-4542-b4c5-dd47f310204b" released by "delete_snapshot" :: held 2.135s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e14a155f-df2a-464b-92d8-1d8243b38468 tempest-GroupsV320Test-1836703843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e14a155f-df2a-464b-92d8-1d8243b38468 tempest-GroupsV320Test-1836703843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e14a155f-df2a-464b-92d8-1d8243b38468 tempest-GroupsV320Test-1836703843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e14a155f-df2a-464b-92d8-1d8243b38468 tempest-GroupsV320Test-1836703843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e14a155f-df2a-464b-92d8-1d8243b38468 tempest-GroupsV320Test-1836703843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e14a155f-df2a-464b-92d8-1d8243b38468 tempest-GroupsV320Test-1836703843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:48 devstack sudo[93461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:52:48 devstack sudo[93461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:48 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-58ccf763-f603-4959-bd6a-bb4049f5faf1 tempest-SnapshotsActionsTest-678415562 None] Created reservations ['77ba6fb7-5a07-468f-a029-8073cf818301', '18c4e75f-b7d7-4198-acbc-fd9aad503d28', 'a5858d45-c06c-4c07-b79b-1b7d6d75ed40', '4d8e7d58-446c-40c3-9be7-61ba9c83d02e'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:48 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-58ccf763-f603-4959-bd6a-bb4049f5faf1 tempest-SnapshotsActionsTest-678415562 None] Delete snapshot completed successfully. Nov 04 18:52:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-58ccf763-f603-4959-bd6a-bb4049f5faf1 tempest-SnapshotsActionsTest-678415562 None] Lock "cinder-e03e3472-789e-4eb0-b9f0-49d330e7d1f8-delete_snapshot" released by "delete_snapshot" :: held 2.347s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:48 devstack sudo[93461]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e14a155f-df2a-464b-92d8-1d8243b38468 tempest-GroupsV320Test-1836703843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.342s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:48 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-e14a155f-df2a-464b-92d8-1d8243b38468 tempest-GroupsV320Test-1836703843 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:52:48 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e14a155f-df2a-464b-92d8-1d8243b38468 tempest-GroupsV320Test-1836703843 None] Delete group completed successfully. Nov 04 18:52:49 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:52:49 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Flow 'volume_create_manager' (edd7dbcd-8ebb-43e5-9618-3cccc0dfc466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:52:49 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec3fc119-0dbc-40b9-91a9-c74a1bf09349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:49 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec3fc119-0dbc-40b9-91a9-c74a1bf09349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-473947883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1969dd24-b27c-44be-8da2-2459816e6b71,host='devstack@QuobyteHD#QuobyteHD',id=d0b43231-03bd-46db-a0ee-a45844085d89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68623afa0c214601bdec4e8e175718dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:52:49Z,use_quota=True,user_id='99a5e0cbf21448169b721faeea4317f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2654ebc3-7504-491f-b103-6062422ed4d6),volume_type_id=2654ebc3-7504-491f-b103-6062422ed4d6)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:49 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6602c4be-068b-4770-960c-103fa280b4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:49 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6602c4be-068b-4770-960c-103fa280b4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:49 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa4b0af6-5e90-4212-8a45-dc61b256747c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:49 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa4b0af6-5e90-4212-8a45-dc61b256747c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0b43231-03bd-46db-a0ee-a45844085d89', 'volume_name': 'volume-d0b43231-03bd-46db-a0ee-a45844085d89', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:49 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b32e076-24f0-45f7-8140-a1b40aa280d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:49 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b32e076-24f0-45f7-8140-a1b40aa280d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:49 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a364d3a8-1aa9-46be-952b-c13860164448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:49 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Volume d0b43231-03bd-46db-a0ee-a45844085d89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0b43231-03bd-46db-a0ee-a45844085d89', 'volume_size': 1} Nov 04 18:52:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:49 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1969dd24-b27c-44be-8da2-2459816e6b71,created_at=2026-11-04T17:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-473947883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1969dd24-b27c-44be-8da2-2459816e6b71,host='devstack@QuobyteHD#QuobyteHD',id=d0b43231-03bd-46db-a0ee-a45844085d89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68623afa0c214601bdec4e8e175718dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:52:49Z,use_quota=True,user_id='99a5e0cbf21448169b721faeea4317f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2654ebc3-7504-491f-b103-6062422ed4d6),volume_type_id=2654ebc3-7504-491f-b103-6062422ed4d6)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:52:49 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Creating volume d0b43231-03bd-46db-a0ee-a45844085d89 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:52:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:49 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:49 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:49 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:52:49 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:52:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:49 devstack sudo[93464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89 1073741824 Nov 04 18:52:49 devstack sudo[93464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1fb0a861-6ae4-4ac3-9b74-621b3e5c8c90 tempest-SnapshotsActionsTest-538702046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:50 devstack sudo[93464]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89 1073741824" returned: 0 in 0.760s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:50 devstack sudo[93473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89 Nov 04 18:52:50 devstack sudo[93473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:50 devstack sudo[93473]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89" returned: 0 in 0.375s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:50 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:52:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1fb0a861-6ae4-4ac3-9b74-621b3e5c8c90 tempest-SnapshotsActionsTest-538702046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.709s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:50 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a364d3a8-1aa9-46be-952b-c13860164448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0b43231-03bd-46db-a0ee-a45844085d89', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:50 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d9c0ae7-d9c8-42f2-b3e3-ed0323d7eb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:50 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-1fb0a861-6ae4-4ac3-9b74-621b3e5c8c90 tempest-SnapshotsActionsTest-538702046 None] Creating offline snapshot 0afb3782-6fac-47e6-8817-c2d6eacd75ee of volume 72687c70-1ffb-4542-b4c5-dd47f310204b {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:52:50 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Volume volume-d0b43231-03bd-46db-a0ee-a45844085d89 (d0b43231-03bd-46db-a0ee-a45844085d89): created successfully Nov 04 18:52:50 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d9c0ae7-d9c8-42f2-b3e3-ed0323d7eb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:50 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Flow 'volume_create_manager' (edd7dbcd-8ebb-43e5-9618-3cccc0dfc466) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:52:50 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bef3a2-ae4d-4d6f-8eab-1d21b83a93ad]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1fb0a861-6ae4-4ac3-9b74-621b3e5c8c90 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:50 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-da665dcb-b9bc-485b-8347-854623a5f419 tempest-GroupSnapshotsTest-1933020210 None] Created volume successfully. Nov 04 18:52:50 devstack sudo[93476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 Nov 04 18:52:50 devstack sudo[93476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:51 devstack sudo[93476]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1fb0a861-6ae4-4ac3-9b74-621b3e5c8c90 tempest-SnapshotsActionsTest-538702046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765" returned: 0 in 0.502s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:51 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-1fb0a861-6ae4-4ac3-9b74-621b3e5c8c90 tempest-SnapshotsActionsTest-538702046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72687c70-1ffb-4542-b4c5-dd47f310204b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:52:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1fb0a861-6ae4-4ac3-9b74-621b3e5c8c90 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.0afb3782-6fac-47e6-8817-c2d6eacd75ee 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:51 devstack sudo[93481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.0afb3782-6fac-47e6-8817-c2d6eacd75ee 1G Nov 04 18:52:51 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:51 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1fb0a861-6ae4-4ac3-9b74-621b3e5c8c90 tempest-SnapshotsActionsTest-538702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.0afb3782-6fac-47e6-8817-c2d6eacd75ee 1G" returned: 0 in 0.512s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1fb0a861-6ae4-4ac3-9b74-621b3e5c8c90 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.0afb3782-6fac-47e6-8817-c2d6eacd75ee {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:51 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.0afb3782-6fac-47e6-8817-c2d6eacd75ee Nov 04 18:52:51 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:51 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e740b92e-93f0-47db-abb8-afc6b76b1509 tempest-GroupSnapshotsTest-1933020210 None] GroupSnapshot bb7e1a60-2d28-43ba-956b-bafbb102f53d: creating. Nov 04 18:52:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e740b92e-93f0-47db-abb8-afc6b76b1509 tempest-GroupSnapshotsTest-1933020210 None] Group snapshot bb7e1a60-2d28-43ba-956b-bafbb102f53d: creating. {{(pid=87119) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 04 18:52:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e740b92e-93f0-47db-abb8-afc6b76b1509 tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:52 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1fb0a861-6ae4-4ac3-9b74-621b3e5c8c90 tempest-SnapshotsActionsTest-538702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.0afb3782-6fac-47e6-8817-c2d6eacd75ee" returned: 0 in 0.441s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:52 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-1fb0a861-6ae4-4ac3-9b74-621b3e5c8c90 tempest-SnapshotsActionsTest-538702046 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.0afb3782-6fac-47e6-8817-c2d6eacd75ee is being set with open permissions: ugo+rw Nov 04 18:52:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1fb0a861-6ae4-4ac3-9b74-621b3e5c8c90 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.0afb3782-6fac-47e6-8817-c2d6eacd75ee {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:52 devstack sudo[93492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.0afb3782-6fac-47e6-8817-c2d6eacd75ee Nov 04 18:52:52 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:52 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1fb0a861-6ae4-4ac3-9b74-621b3e5c8c90 tempest-SnapshotsActionsTest-538702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.0afb3782-6fac-47e6-8817-c2d6eacd75ee" returned: 0 in 0.292s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1fb0a861-6ae4-4ac3-9b74-621b3e5c8c90 tempest-SnapshotsActionsTest-538702046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.910s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e740b92e-93f0-47db-abb8-afc6b76b1509 tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.375s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:52 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-e740b92e-93f0-47db-abb8-afc6b76b1509 tempest-GroupSnapshotsTest-1933020210 None] Creating offline snapshot 8250e5fe-fa54-4d91-b215-3eb0ac4e76c7 of volume d0b43231-03bd-46db-a0ee-a45844085d89 {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:52:52 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-1fb0a861-6ae4-4ac3-9b74-621b3e5c8c90 tempest-SnapshotsActionsTest-538702046 None] Create snapshot completed successfully Nov 04 18:52:52 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cfd7fb-955c-4b06-9c4b-ad2609fcdc21]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e740b92e-93f0-47db-abb8-afc6b76b1509 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:52 devstack sudo[93495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89 Nov 04 18:52:52 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:52 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e740b92e-93f0-47db-abb8-afc6b76b1509 tempest-GroupSnapshotsTest-1933020210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89" returned: 0 in 0.392s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e740b92e-93f0-47db-abb8-afc6b76b1509 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89.8250e5fe-fa54-4d91-b215-3eb0ac4e76c7 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:52 devstack sudo[93501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89.8250e5fe-fa54-4d91-b215-3eb0ac4e76c7 1G Nov 04 18:52:52 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:53 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1d1aac75-acf2-49e2-a977-7ef4dfe3301c tempest-SnapshotsActionsTest-678415562 None] Acquiring lock "cinder-0afb3782-6fac-47e6-8817-c2d6eacd75ee-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:53 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1d1aac75-acf2-49e2-a977-7ef4dfe3301c tempest-SnapshotsActionsTest-678415562 None] Lock "cinder-0afb3782-6fac-47e6-8817-c2d6eacd75ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:53 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1d1aac75-acf2-49e2-a977-7ef4dfe3301c tempest-SnapshotsActionsTest-678415562 None] Acquiring lock "cinder-quobyte-72687c70-1ffb-4542-b4c5-dd47f310204b" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:53 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1d1aac75-acf2-49e2-a977-7ef4dfe3301c tempest-SnapshotsActionsTest-678415562 None] Lock "cinder-quobyte-72687c70-1ffb-4542-b4c5-dd47f310204b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:53 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1d1aac75-acf2-49e2-a977-7ef4dfe3301c tempest-SnapshotsActionsTest-678415562 None] Acquiring lock "cinder-quobyte-0afb3782-6fac-47e6-8817-c2d6eacd75ee" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:53 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1d1aac75-acf2-49e2-a977-7ef4dfe3301c tempest-SnapshotsActionsTest-678415562 None] Lock "cinder-quobyte-0afb3782-6fac-47e6-8817-c2d6eacd75ee" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:53 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-1d1aac75-acf2-49e2-a977-7ef4dfe3301c tempest-SnapshotsActionsTest-678415562 None] Deleting offline snapshot 0afb3782-6fac-47e6-8817-c2d6eacd75ee of volume 72687c70-1ffb-4542-b4c5-dd47f310204b {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:52:53 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-1d1aac75-acf2-49e2-a977-7ef4dfe3301c tempest-SnapshotsActionsTest-678415562 None] snapshot_file for this snap is: volume-72687c70-1ffb-4542-b4c5-dd47f310204b.0afb3782-6fac-47e6-8817-c2d6eacd75ee {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:52:53 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea92a1c0-39fd-4192-acd6-c0712998e9d8]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1d1aac75-acf2-49e2-a977-7ef4dfe3301c tempest-SnapshotsActionsTest-678415562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.0afb3782-6fac-47e6-8817-c2d6eacd75ee {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:53 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e740b92e-93f0-47db-abb8-afc6b76b1509 tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89.8250e5fe-fa54-4d91-b215-3eb0ac4e76c7 1G" returned: 0 in 0.549s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e740b92e-93f0-47db-abb8-afc6b76b1509 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0b43231-03bd-46db-a0ee-a45844085d89 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89.8250e5fe-fa54-4d91-b215-3eb0ac4e76c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:53 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.0afb3782-6fac-47e6-8817-c2d6eacd75ee Nov 04 18:52:53 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:53 devstack sudo[93508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0b43231-03bd-46db-a0ee-a45844085d89 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89.8250e5fe-fa54-4d91-b215-3eb0ac4e76c7 Nov 04 18:52:53 devstack sudo[93508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:53 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1d1aac75-acf2-49e2-a977-7ef4dfe3301c tempest-SnapshotsActionsTest-678415562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.0afb3782-6fac-47e6-8817-c2d6eacd75ee" returned: 0 in 0.481s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:53 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-1d1aac75-acf2-49e2-a977-7ef4dfe3301c tempest-SnapshotsActionsTest-678415562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72687c70-1ffb-4542-b4c5-dd47f310204b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:52:53 devstack sudo[93508]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e740b92e-93f0-47db-abb8-afc6b76b1509 tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0b43231-03bd-46db-a0ee-a45844085d89 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89.8250e5fe-fa54-4d91-b215-3eb0ac4e76c7" returned: 0 in 0.380s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:53 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-e740b92e-93f0-47db-abb8-afc6b76b1509 tempest-GroupSnapshotsTest-1933020210 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89.8250e5fe-fa54-4d91-b215-3eb0ac4e76c7 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 18:52:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e740b92e-93f0-47db-abb8-afc6b76b1509 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89.8250e5fe-fa54-4d91-b215-3eb0ac4e76c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:53 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd5988d-550f-4d7f-a096-f043f8c293aa]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1d1aac75-acf2-49e2-a977-7ef4dfe3301c tempest-SnapshotsActionsTest-678415562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:53 devstack sudo[93519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89.8250e5fe-fa54-4d91-b215-3eb0ac4e76c7 Nov 04 18:52:53 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:53 devstack sudo[93520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 Nov 04 18:52:53 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:54 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e740b92e-93f0-47db-abb8-afc6b76b1509 tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89.8250e5fe-fa54-4d91-b215-3eb0ac4e76c7" returned: 0 in 0.357s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e740b92e-93f0-47db-abb8-afc6b76b1509 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:54 devstack sudo[93526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89.info Nov 04 18:52:54 devstack sudo[93526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:54 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1d1aac75-acf2-49e2-a977-7ef4dfe3301c tempest-SnapshotsActionsTest-678415562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765" returned: 0 in 0.475s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:54 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-1d1aac75-acf2-49e2-a977-7ef4dfe3301c tempest-SnapshotsActionsTest-678415562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72687c70-1ffb-4542-b4c5-dd47f310204b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:52:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1d1aac75-acf2-49e2-a977-7ef4dfe3301c tempest-SnapshotsActionsTest-678415562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.0afb3782-6fac-47e6-8817-c2d6eacd75ee {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:54 devstack sudo[93529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.0afb3782-6fac-47e6-8817-c2d6eacd75ee Nov 04 18:52:54 devstack sudo[93529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:54 devstack sudo[93526]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e740b92e-93f0-47db-abb8-afc6b76b1509 tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89.info" returned: 0 in 0.385s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:54 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-e740b92e-93f0-47db-abb8-afc6b76b1509 tempest-GroupSnapshotsTest-1933020210 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 18:52:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e740b92e-93f0-47db-abb8-afc6b76b1509 tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:54 devstack sudo[93536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89.info Nov 04 18:52:54 devstack sudo[93536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:54 devstack sudo[93529]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1d1aac75-acf2-49e2-a977-7ef4dfe3301c tempest-SnapshotsActionsTest-678415562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.0afb3782-6fac-47e6-8817-c2d6eacd75ee" returned: 0 in 0.426s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1d1aac75-acf2-49e2-a977-7ef4dfe3301c tempest-SnapshotsActionsTest-678415562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.0afb3782-6fac-47e6-8817-c2d6eacd75ee {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:54 devstack sudo[93538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.0afb3782-6fac-47e6-8817-c2d6eacd75ee Nov 04 18:52:54 devstack sudo[93538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:54 devstack sudo[93536]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e740b92e-93f0-47db-abb8-afc6b76b1509 tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89.info" returned: 0 in 0.299s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e740b92e-93f0-47db-abb8-afc6b76b1509 tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.493s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:54 devstack sudo[93538]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1d1aac75-acf2-49e2-a977-7ef4dfe3301c tempest-SnapshotsActionsTest-678415562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.0afb3782-6fac-47e6-8817-c2d6eacd75ee" returned: 0 in 0.269s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:55 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1d1aac75-acf2-49e2-a977-7ef4dfe3301c tempest-SnapshotsActionsTest-678415562 None] Lock "cinder-quobyte-0afb3782-6fac-47e6-8817-c2d6eacd75ee" released by "_delete_snapshot" :: held 1.791s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:55 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1d1aac75-acf2-49e2-a977-7ef4dfe3301c tempest-SnapshotsActionsTest-678415562 None] Lock "cinder-quobyte-72687c70-1ffb-4542-b4c5-dd47f310204b" released by "delete_snapshot" :: held 1.823s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:55 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e740b92e-93f0-47db-abb8-afc6b76b1509 tempest-GroupSnapshotsTest-1933020210 None] group_snapshot bb7e1a60-2d28-43ba-956b-bafbb102f53d: created successfully Nov 04 18:52:55 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-1d1aac75-acf2-49e2-a977-7ef4dfe3301c tempest-SnapshotsActionsTest-678415562 None] Created reservations ['5874e8d1-dcde-4478-beec-676dcf4d9cdb', '8995a71e-e708-4d05-a787-fe22d097e306', '5e219ba4-da22-4b4c-a7e6-04d8e78aeea5', '09cb2460-f10f-4689-ba0f-836925a71927'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:55 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-1d1aac75-acf2-49e2-a977-7ef4dfe3301c tempest-SnapshotsActionsTest-678415562 None] Delete snapshot completed successfully. Nov 04 18:52:55 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1d1aac75-acf2-49e2-a977-7ef4dfe3301c tempest-SnapshotsActionsTest-678415562 None] Lock "cinder-0afb3782-6fac-47e6-8817-c2d6eacd75ee-delete_snapshot" released by "delete_snapshot" :: held 2.006s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:55 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-cbadfd45-0b0f-44bb-8116-a5a85d32c21f tempest-GroupSnapshotsTest-1933020210 None] group_snapshot bb7e1a60-2d28-43ba-956b-bafbb102f53d: deleting Nov 04 18:52:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cbadfd45-0b0f-44bb-8116-a5a85d32c21f tempest-GroupSnapshotsTest-1933020210 None] group_snapshot bb7e1a60-2d28-43ba-956b-bafbb102f53d: deleting {{(pid=87119) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 04 18:52:55 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-cbadfd45-0b0f-44bb-8116-a5a85d32c21f tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "cinder-quobyte-d0b43231-03bd-46db-a0ee-a45844085d89" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:55 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-cbadfd45-0b0f-44bb-8116-a5a85d32c21f tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-d0b43231-03bd-46db-a0ee-a45844085d89" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:55 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-cbadfd45-0b0f-44bb-8116-a5a85d32c21f tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "cinder-quobyte-8250e5fe-fa54-4d91-b215-3eb0ac4e76c7" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:55 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-cbadfd45-0b0f-44bb-8116-a5a85d32c21f tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-8250e5fe-fa54-4d91-b215-3eb0ac4e76c7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:55 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-cbadfd45-0b0f-44bb-8116-a5a85d32c21f tempest-GroupSnapshotsTest-1933020210 None] Deleting offline snapshot 8250e5fe-fa54-4d91-b215-3eb0ac4e76c7 of volume d0b43231-03bd-46db-a0ee-a45844085d89 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:52:55 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-cbadfd45-0b0f-44bb-8116-a5a85d32c21f tempest-GroupSnapshotsTest-1933020210 None] snapshot_file for this snap is: volume-d0b43231-03bd-46db-a0ee-a45844085d89.8250e5fe-fa54-4d91-b215-3eb0ac4e76c7 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:52:55 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[2638255a-a0bb-4e7d-8480-ac8e26990f1a]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cbadfd45-0b0f-44bb-8116-a5a85d32c21f tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89.8250e5fe-fa54-4d91-b215-3eb0ac4e76c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:55 devstack sudo[93542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89.8250e5fe-fa54-4d91-b215-3eb0ac4e76c7 Nov 04 18:52:55 devstack sudo[93542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e83e43c6-11e6-431f-84a2-16ffde841b11 tempest-SnapshotsActionsTest-538702046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e83e43c6-11e6-431f-84a2-16ffde841b11 tempest-SnapshotsActionsTest-538702046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:55 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-e83e43c6-11e6-431f-84a2-16ffde841b11 tempest-SnapshotsActionsTest-538702046 None] Creating offline snapshot 2702a4a9-00de-4738-8a3a-99f8418070df of volume 72687c70-1ffb-4542-b4c5-dd47f310204b {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:52:55 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14b151b-ef36-4459-90fb-4456c81f44dc]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e83e43c6-11e6-431f-84a2-16ffde841b11 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:56 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 Nov 04 18:52:56 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:56 devstack sudo[93542]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cbadfd45-0b0f-44bb-8116-a5a85d32c21f tempest-GroupSnapshotsTest-1933020210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89.8250e5fe-fa54-4d91-b215-3eb0ac4e76c7" returned: 0 in 0.502s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:56 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-cbadfd45-0b0f-44bb-8116-a5a85d32c21f tempest-GroupSnapshotsTest-1933020210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0b43231-03bd-46db-a0ee-a45844085d89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:52:56 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b2d905-779c-4afe-8647-a1c8c8bfee74]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cbadfd45-0b0f-44bb-8116-a5a85d32c21f tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:56 devstack sudo[93549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89 Nov 04 18:52:56 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:56 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e83e43c6-11e6-431f-84a2-16ffde841b11 tempest-SnapshotsActionsTest-538702046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765" returned: 0 in 0.440s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:56 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-e83e43c6-11e6-431f-84a2-16ffde841b11 tempest-SnapshotsActionsTest-538702046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72687c70-1ffb-4542-b4c5-dd47f310204b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:52:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e83e43c6-11e6-431f-84a2-16ffde841b11 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.2702a4a9-00de-4738-8a3a-99f8418070df 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:56 devstack sudo[93555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.2702a4a9-00de-4738-8a3a-99f8418070df 1G Nov 04 18:52:56 devstack sudo[93555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:56 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cbadfd45-0b0f-44bb-8116-a5a85d32c21f tempest-GroupSnapshotsTest-1933020210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89" returned: 0 in 0.463s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cbadfd45-0b0f-44bb-8116-a5a85d32c21f tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89.8250e5fe-fa54-4d91-b215-3eb0ac4e76c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:56 devstack sudo[93561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89.8250e5fe-fa54-4d91-b215-3eb0ac4e76c7 Nov 04 18:52:56 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:57 devstack sudo[93555]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e83e43c6-11e6-431f-84a2-16ffde841b11 tempest-SnapshotsActionsTest-538702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.2702a4a9-00de-4738-8a3a-99f8418070df 1G" returned: 0 in 0.602s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e83e43c6-11e6-431f-84a2-16ffde841b11 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.2702a4a9-00de-4738-8a3a-99f8418070df {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:57 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.2702a4a9-00de-4738-8a3a-99f8418070df Nov 04 18:52:57 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:57 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cbadfd45-0b0f-44bb-8116-a5a85d32c21f tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89.8250e5fe-fa54-4d91-b215-3eb0ac4e76c7" returned: 0 in 0.468s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cbadfd45-0b0f-44bb-8116-a5a85d32c21f tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89.8250e5fe-fa54-4d91-b215-3eb0ac4e76c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:57 devstack sudo[93573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89.8250e5fe-fa54-4d91-b215-3eb0ac4e76c7 Nov 04 18:52:57 devstack sudo[93573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:57 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e83e43c6-11e6-431f-84a2-16ffde841b11 tempest-SnapshotsActionsTest-538702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.2702a4a9-00de-4738-8a3a-99f8418070df" returned: 0 in 0.364s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:57 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-e83e43c6-11e6-431f-84a2-16ffde841b11 tempest-SnapshotsActionsTest-538702046 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.2702a4a9-00de-4738-8a3a-99f8418070df is being set with open permissions: ugo+rw Nov 04 18:52:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e83e43c6-11e6-431f-84a2-16ffde841b11 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.2702a4a9-00de-4738-8a3a-99f8418070df {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:57 devstack sudo[93578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.2702a4a9-00de-4738-8a3a-99f8418070df Nov 04 18:52:57 devstack sudo[93578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:57 devstack sudo[93573]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cbadfd45-0b0f-44bb-8116-a5a85d32c21f tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89.8250e5fe-fa54-4d91-b215-3eb0ac4e76c7" returned: 0 in 0.380s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:57 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-cbadfd45-0b0f-44bb-8116-a5a85d32c21f tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-8250e5fe-fa54-4d91-b215-3eb0ac4e76c7" released by "_delete_snapshot" :: held 1.970s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:57 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-cbadfd45-0b0f-44bb-8116-a5a85d32c21f tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-d0b43231-03bd-46db-a0ee-a45844085d89" released by "delete_snapshot" :: held 2.003s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:57 devstack cinder-volume[87119]: WARNING cinder.quota [None req-cbadfd45-0b0f-44bb-8116-a5a85d32c21f tempest-GroupSnapshotsTest-1933020210 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1244041844 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1244041844, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:52:57 devstack cinder-volume[87119]: WARNING cinder.quota [None req-cbadfd45-0b0f-44bb-8116-a5a85d32c21f tempest-GroupSnapshotsTest-1933020210 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1244041844 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1244041844, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:52:57 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-cbadfd45-0b0f-44bb-8116-a5a85d32c21f tempest-GroupSnapshotsTest-1933020210 None] Created reservations ['4b47894a-02d8-48e7-8991-6b722209a046', '879f2bba-836e-4cd2-8c18-2773ebcc8f2c', 'b872af17-b4e3-4c71-abeb-b8c7d7eae977', 'b9f7bf3a-0858-41de-8077-058164dcbb8f'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:57 devstack sudo[93578]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e83e43c6-11e6-431f-84a2-16ffde841b11 tempest-SnapshotsActionsTest-538702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.2702a4a9-00de-4738-8a3a-99f8418070df" returned: 0 in 0.332s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e83e43c6-11e6-431f-84a2-16ffde841b11 tempest-SnapshotsActionsTest-538702046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.852s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:57 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e83e43c6-11e6-431f-84a2-16ffde841b11 tempest-SnapshotsActionsTest-538702046 None] Create snapshot completed successfully Nov 04 18:52:57 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-cbadfd45-0b0f-44bb-8116-a5a85d32c21f tempest-GroupSnapshotsTest-1933020210 None] group_snapshot bb7e1a60-2d28-43ba-956b-bafbb102f53d: deleted successfully Nov 04 18:52:58 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-18864771-0a8a-413c-aff4-768ea3a6e16a tempest-SnapshotsActionsTest-678415562 None] Acquiring lock "cinder-2702a4a9-00de-4738-8a3a-99f8418070df-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:58 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-18864771-0a8a-413c-aff4-768ea3a6e16a tempest-SnapshotsActionsTest-678415562 None] Lock "cinder-2702a4a9-00de-4738-8a3a-99f8418070df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:58 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-18864771-0a8a-413c-aff4-768ea3a6e16a tempest-SnapshotsActionsTest-678415562 None] Acquiring lock "cinder-quobyte-72687c70-1ffb-4542-b4c5-dd47f310204b" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:58 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-18864771-0a8a-413c-aff4-768ea3a6e16a tempest-SnapshotsActionsTest-678415562 None] Lock "cinder-quobyte-72687c70-1ffb-4542-b4c5-dd47f310204b" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:58 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-18864771-0a8a-413c-aff4-768ea3a6e16a tempest-SnapshotsActionsTest-678415562 None] Acquiring lock "cinder-quobyte-2702a4a9-00de-4738-8a3a-99f8418070df" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:58 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-18864771-0a8a-413c-aff4-768ea3a6e16a tempest-SnapshotsActionsTest-678415562 None] Lock "cinder-quobyte-2702a4a9-00de-4738-8a3a-99f8418070df" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:58 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-18864771-0a8a-413c-aff4-768ea3a6e16a tempest-SnapshotsActionsTest-678415562 None] Deleting offline snapshot 2702a4a9-00de-4738-8a3a-99f8418070df of volume 72687c70-1ffb-4542-b4c5-dd47f310204b {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:52:58 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-18864771-0a8a-413c-aff4-768ea3a6e16a tempest-SnapshotsActionsTest-678415562 None] snapshot_file for this snap is: volume-72687c70-1ffb-4542-b4c5-dd47f310204b.2702a4a9-00de-4738-8a3a-99f8418070df {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:52:58 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[46871b8f-aa67-4fe5-97a9-96c8ab03525a]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-18864771-0a8a-413c-aff4-768ea3a6e16a tempest-SnapshotsActionsTest-678415562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.2702a4a9-00de-4738-8a3a-99f8418070df {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:58 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-de4c1f9e-b3e3-4913-b646-54f4ad0cb43a tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "cinder-quobyte-d0b43231-03bd-46db-a0ee-a45844085d89" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:58 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-de4c1f9e-b3e3-4913-b646-54f4ad0cb43a tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-d0b43231-03bd-46db-a0ee-a45844085d89" acquired by "delete_volume" :: waited 0.020s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:58 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff94aaa-3689-430b-8876-236fc026d098]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-de4c1f9e-b3e3-4913-b646-54f4ad0cb43a tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:58 devstack sudo[93582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.2702a4a9-00de-4738-8a3a-99f8418070df Nov 04 18:52:58 devstack sudo[93582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:58 devstack sudo[93618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89 Nov 04 18:52:58 devstack sudo[93618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:58 devstack sudo[93582]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-18864771-0a8a-413c-aff4-768ea3a6e16a tempest-SnapshotsActionsTest-678415562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.2702a4a9-00de-4738-8a3a-99f8418070df" returned: 0 in 0.588s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:58 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-18864771-0a8a-413c-aff4-768ea3a6e16a tempest-SnapshotsActionsTest-678415562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72687c70-1ffb-4542-b4c5-dd47f310204b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:52:58 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9c79f4-3aeb-4852-8a47-e60d1dbe46d3]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:58 devstack sudo[93618]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-18864771-0a8a-413c-aff4-768ea3a6e16a tempest-SnapshotsActionsTest-678415562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-de4c1f9e-b3e3-4913-b646-54f4ad0cb43a tempest-GroupSnapshotsTest-1933020210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89" returned: 0 in 0.486s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-de4c1f9e-b3e3-4913-b646-54f4ad0cb43a tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:58 devstack sudo[93629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89 Nov 04 18:52:58 devstack sudo[93629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:59 devstack sudo[93628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 Nov 04 18:52:59 devstack sudo[93628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:59 devstack sudo[93629]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-de4c1f9e-b3e3-4913-b646-54f4ad0cb43a tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d0b43231-03bd-46db-a0ee-a45844085d89" returned: 0 in 0.291s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:59 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-de4c1f9e-b3e3-4913-b646-54f4ad0cb43a tempest-GroupSnapshotsTest-1933020210 None] Lock "cinder-quobyte-d0b43231-03bd-46db-a0ee-a45844085d89" released by "delete_volume" :: held 0.899s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:59 devstack sudo[93628]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:59 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-de4c1f9e-b3e3-4913-b646-54f4ad0cb43a tempest-GroupSnapshotsTest-1933020210 None] Created reservations ['0a1e0fd3-3bcf-45de-b5c5-522e51497bca'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-18864771-0a8a-413c-aff4-768ea3a6e16a tempest-SnapshotsActionsTest-678415562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765" returned: 0 in 0.428s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:59 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-18864771-0a8a-413c-aff4-768ea3a6e16a tempest-SnapshotsActionsTest-678415562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72687c70-1ffb-4542-b4c5-dd47f310204b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:52:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-18864771-0a8a-413c-aff4-768ea3a6e16a tempest-SnapshotsActionsTest-678415562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.2702a4a9-00de-4738-8a3a-99f8418070df {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:59 devstack sudo[93636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.2702a4a9-00de-4738-8a3a-99f8418070df Nov 04 18:52:59 devstack sudo[93636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:59 devstack cinder-volume[87119]: WARNING cinder.quota [None req-de4c1f9e-b3e3-4913-b646-54f4ad0cb43a tempest-GroupSnapshotsTest-1933020210 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1244041844 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1244041844, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:52:59 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-de4c1f9e-b3e3-4913-b646-54f4ad0cb43a tempest-GroupSnapshotsTest-1933020210 None] Created reservations ['6f907b6c-13cf-4ee7-9d71-631e885abec5', '63f71a98-e239-4591-b116-e06a9ae403dc', '2ac73235-2f4f-4372-af16-c212c069893b', '051ce517-b251-4f94-9704-16322e45ad29'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-de4c1f9e-b3e3-4913-b646-54f4ad0cb43a tempest-GroupSnapshotsTest-1933020210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-de4c1f9e-b3e3-4913-b646-54f4ad0cb43a tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:59 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-de4c1f9e-b3e3-4913-b646-54f4ad0cb43a tempest-GroupSnapshotsTest-1933020210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:59 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-de4c1f9e-b3e3-4913-b646-54f4ad0cb43a tempest-GroupSnapshotsTest-1933020210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-de4c1f9e-b3e3-4913-b646-54f4ad0cb43a tempest-GroupSnapshotsTest-1933020210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-de4c1f9e-b3e3-4913-b646-54f4ad0cb43a tempest-GroupSnapshotsTest-1933020210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:59 devstack sudo[93640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:52:59 devstack sudo[93640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:59 devstack sudo[93636]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-18864771-0a8a-413c-aff4-768ea3a6e16a tempest-SnapshotsActionsTest-678415562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.2702a4a9-00de-4738-8a3a-99f8418070df" returned: 0 in 0.507s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-18864771-0a8a-413c-aff4-768ea3a6e16a tempest-SnapshotsActionsTest-678415562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.2702a4a9-00de-4738-8a3a-99f8418070df {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:59 devstack sudo[93640]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:59 devstack sudo[93645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.2702a4a9-00de-4738-8a3a-99f8418070df Nov 04 18:52:59 devstack sudo[93645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-de4c1f9e-b3e3-4913-b646-54f4ad0cb43a tempest-GroupSnapshotsTest-1933020210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.323s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:59 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-de4c1f9e-b3e3-4913-b646-54f4ad0cb43a tempest-GroupSnapshotsTest-1933020210 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:52:59 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-de4c1f9e-b3e3-4913-b646-54f4ad0cb43a tempest-GroupSnapshotsTest-1933020210 None] Delete group completed successfully. Nov 04 18:53:00 devstack sudo[93645]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-18864771-0a8a-413c-aff4-768ea3a6e16a tempest-SnapshotsActionsTest-678415562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.2702a4a9-00de-4738-8a3a-99f8418070df" returned: 0 in 0.337s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:00 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-18864771-0a8a-413c-aff4-768ea3a6e16a tempest-SnapshotsActionsTest-678415562 None] Lock "cinder-quobyte-2702a4a9-00de-4738-8a3a-99f8418070df" released by "_delete_snapshot" :: held 2.009s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:00 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-18864771-0a8a-413c-aff4-768ea3a6e16a tempest-SnapshotsActionsTest-678415562 None] Lock "cinder-quobyte-72687c70-1ffb-4542-b4c5-dd47f310204b" released by "delete_snapshot" :: held 2.053s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:00 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-18864771-0a8a-413c-aff4-768ea3a6e16a tempest-SnapshotsActionsTest-678415562 None] Created reservations ['95a5eda8-5996-400e-99f4-1fff2a5c7081', 'a21ba17a-002a-4b7f-8b6e-095f9757f2a6', 'd1875aa0-0351-434b-a1d8-cc19ac5078fa', '38f7772e-1ae2-4d99-a9b5-fb39e93797fc'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:53:00 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-18864771-0a8a-413c-aff4-768ea3a6e16a tempest-SnapshotsActionsTest-678415562 None] Delete snapshot completed successfully. Nov 04 18:53:00 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-18864771-0a8a-413c-aff4-768ea3a6e16a tempest-SnapshotsActionsTest-678415562 None] Lock "cinder-2702a4a9-00de-4738-8a3a-99f8418070df-delete_snapshot" released by "delete_snapshot" :: held 2.259s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:02 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7d396ca2-721a-4e3c-a2ef-5cf61dee04a8 tempest-SnapshotsActionsTest-538702046 None] Acquiring lock "cinder-f289e43a-27d6-4da4-ade2-403ca4ea7765-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:02 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7d396ca2-721a-4e3c-a2ef-5cf61dee04a8 tempest-SnapshotsActionsTest-538702046 None] Lock "cinder-f289e43a-27d6-4da4-ade2-403ca4ea7765-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:02 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7d396ca2-721a-4e3c-a2ef-5cf61dee04a8 tempest-SnapshotsActionsTest-538702046 None] Acquiring lock "cinder-quobyte-72687c70-1ffb-4542-b4c5-dd47f310204b" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:02 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7d396ca2-721a-4e3c-a2ef-5cf61dee04a8 tempest-SnapshotsActionsTest-538702046 None] Lock "cinder-quobyte-72687c70-1ffb-4542-b4c5-dd47f310204b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:02 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7d396ca2-721a-4e3c-a2ef-5cf61dee04a8 tempest-SnapshotsActionsTest-538702046 None] Acquiring lock "cinder-quobyte-f289e43a-27d6-4da4-ade2-403ca4ea7765" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:02 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7d396ca2-721a-4e3c-a2ef-5cf61dee04a8 tempest-SnapshotsActionsTest-538702046 None] Lock "cinder-quobyte-f289e43a-27d6-4da4-ade2-403ca4ea7765" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-7d396ca2-721a-4e3c-a2ef-5cf61dee04a8 tempest-SnapshotsActionsTest-538702046 None] Deleting offline snapshot f289e43a-27d6-4da4-ade2-403ca4ea7765 of volume 72687c70-1ffb-4542-b4c5-dd47f310204b {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:53:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-7d396ca2-721a-4e3c-a2ef-5cf61dee04a8 tempest-SnapshotsActionsTest-538702046 None] snapshot_file for this snap is: volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:53:02 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee1655e-be27-4896-b299-91511a8d41e8]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7d396ca2-721a-4e3c-a2ef-5cf61dee04a8 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:02 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 Nov 04 18:53:02 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:02 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7d396ca2-721a-4e3c-a2ef-5cf61dee04a8 tempest-SnapshotsActionsTest-538702046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765" returned: 0 in 0.447s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-7d396ca2-721a-4e3c-a2ef-5cf61dee04a8 tempest-SnapshotsActionsTest-538702046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72687c70-1ffb-4542-b4c5-dd47f310204b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:53:02 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[255ba091-6e88-4d8f-a5b9-f37b43d42d66]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7d396ca2-721a-4e3c-a2ef-5cf61dee04a8 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:02 devstack sudo[93659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b Nov 04 18:53:02 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:03 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7d396ca2-721a-4e3c-a2ef-5cf61dee04a8 tempest-SnapshotsActionsTest-538702046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b" returned: 0 in 0.422s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7d396ca2-721a-4e3c-a2ef-5cf61dee04a8 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:03 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 Nov 04 18:53:03 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:03 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7d396ca2-721a-4e3c-a2ef-5cf61dee04a8 tempest-SnapshotsActionsTest-538702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765" returned: 0 in 0.441s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7d396ca2-721a-4e3c-a2ef-5cf61dee04a8 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:03 devstack sudo[93672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765 Nov 04 18:53:03 devstack sudo[93672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:03 devstack sudo[93672]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7d396ca2-721a-4e3c-a2ef-5cf61dee04a8 tempest-SnapshotsActionsTest-538702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b.f289e43a-27d6-4da4-ade2-403ca4ea7765" returned: 0 in 0.312s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:03 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=187,cinder:UPDATE=206,cinder:DELETE=7,cinder:INSERT=52 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:53:03 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:INSERT=43,cinder:UPDATE=186,cinder:SELECT=180,cinder:DELETE=10 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:53:03 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7d396ca2-721a-4e3c-a2ef-5cf61dee04a8 tempest-SnapshotsActionsTest-538702046 None] Lock "cinder-quobyte-f289e43a-27d6-4da4-ade2-403ca4ea7765" released by "_delete_snapshot" :: held 1.777s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:03 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7d396ca2-721a-4e3c-a2ef-5cf61dee04a8 tempest-SnapshotsActionsTest-538702046 None] Lock "cinder-quobyte-72687c70-1ffb-4542-b4c5-dd47f310204b" released by "delete_snapshot" :: held 1.809s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:04 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-7d396ca2-721a-4e3c-a2ef-5cf61dee04a8 tempest-SnapshotsActionsTest-538702046 None] Created reservations ['37d2dec5-0750-4d98-8e16-7df0d52a053c', '4dc0521b-e3ba-42ad-83fb-a664c2b22187', '80150e47-e711-459f-84a0-308a249d4cc5', '81fad72d-b1f0-4fc7-9124-de5b10ef7272'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:53:04 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-7d396ca2-721a-4e3c-a2ef-5cf61dee04a8 tempest-SnapshotsActionsTest-538702046 None] Delete snapshot completed successfully. Nov 04 18:53:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7d396ca2-721a-4e3c-a2ef-5cf61dee04a8 tempest-SnapshotsActionsTest-538702046 None] Lock "cinder-f289e43a-27d6-4da4-ade2-403ca4ea7765-delete_snapshot" released by "delete_snapshot" :: held 1.999s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7bb955e7-904f-45df-a6ef-518beb33d1a0 tempest-SnapshotsActionsTest-538702046 None] Acquiring lock "cinder-72687c70-1ffb-4542-b4c5-dd47f310204b-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7bb955e7-904f-45df-a6ef-518beb33d1a0 tempest-SnapshotsActionsTest-538702046 None] Lock "cinder-72687c70-1ffb-4542-b4c5-dd47f310204b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7bb955e7-904f-45df-a6ef-518beb33d1a0 tempest-SnapshotsActionsTest-538702046 None] Acquiring lock "cinder-quobyte-72687c70-1ffb-4542-b4c5-dd47f310204b" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7bb955e7-904f-45df-a6ef-518beb33d1a0 tempest-SnapshotsActionsTest-538702046 None] Lock "cinder-quobyte-72687c70-1ffb-4542-b4c5-dd47f310204b" acquired by "delete_volume" :: waited 0.027s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:04 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[34748cd0-462e-4ccd-8958-7ca9adb71945]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7bb955e7-904f-45df-a6ef-518beb33d1a0 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:04 devstack sudo[93675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b Nov 04 18:53:04 devstack sudo[93675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:04 devstack sudo[93675]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7bb955e7-904f-45df-a6ef-518beb33d1a0 tempest-SnapshotsActionsTest-538702046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b" returned: 0 in 0.495s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7bb955e7-904f-45df-a6ef-518beb33d1a0 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:05 devstack sudo[93680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b Nov 04 18:53:05 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:05 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7bb955e7-904f-45df-a6ef-518beb33d1a0 tempest-SnapshotsActionsTest-538702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-72687c70-1ffb-4542-b4c5-dd47f310204b" returned: 0 in 0.289s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7bb955e7-904f-45df-a6ef-518beb33d1a0 tempest-SnapshotsActionsTest-538702046 None] Lock "cinder-quobyte-72687c70-1ffb-4542-b4c5-dd47f310204b" released by "delete_volume" :: held 0.891s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-7bb955e7-904f-45df-a6ef-518beb33d1a0 tempest-SnapshotsActionsTest-538702046 None] Created reservations ['65987080-2ac4-4bc0-a9ef-053628ef2fb9', '4d0ea009-925f-4181-a9ee-3ba61ec1207d', '7a60d7b1-ecd3-454b-8446-0809b88bc48e', 'bae3eff6-efcc-4e36-a1c9-4dd3c55f5e39'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7bb955e7-904f-45df-a6ef-518beb33d1a0 tempest-SnapshotsActionsTest-538702046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7bb955e7-904f-45df-a6ef-518beb33d1a0 tempest-SnapshotsActionsTest-538702046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7bb955e7-904f-45df-a6ef-518beb33d1a0 tempest-SnapshotsActionsTest-538702046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7bb955e7-904f-45df-a6ef-518beb33d1a0 tempest-SnapshotsActionsTest-538702046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7bb955e7-904f-45df-a6ef-518beb33d1a0 tempest-SnapshotsActionsTest-538702046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7bb955e7-904f-45df-a6ef-518beb33d1a0 tempest-SnapshotsActionsTest-538702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:05 devstack sudo[93683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:53:05 devstack sudo[93683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Flow 'volume_create_manager' (a83f86a6-e29b-46e1-b5c1-14126cafa662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c171cb-5a1e-467d-bd12-37b9c513e508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:05 devstack sudo[93683]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7bb955e7-904f-45df-a6ef-518beb33d1a0 tempest-SnapshotsActionsTest-538702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.383s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c171cb-5a1e-467d-bd12-37b9c513e508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1490026876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e62af74-ceb3-4073-be71-10ab85131201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e794cd1e0cfb493cbee7d1cdf551081b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:53:06Z,use_quota=True,user_id='8acbf823e4664d0fbecb5b3443f2c063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ceaa229d-786a-4756-a500-9631626b4f88),volume_type_id=ceaa229d-786a-4756-a500-9631626b4f88)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5743372-0f12-4206-815c-8ed89a8fb972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5743372-0f12-4206-815c-8ed89a8fb972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763da50e-bc95-412c-bc4a-ef489e75d15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763da50e-bc95-412c-bc4a-ef489e75d15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e62af74-ceb3-4073-be71-10ab85131201', 'volume_name': 'volume-2e62af74-ceb3-4073-be71-10ab85131201', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a87351f7-c21b-4c0f-a70f-ab1dce6e0196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a87351f7-c21b-4c0f-a70f-ab1dce6e0196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20abd54b-0498-4d40-bc97-482c013c08ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:05 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Volume 2e62af74-ceb3-4073-be71-10ab85131201: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e62af74-ceb3-4073-be71-10ab85131201', 'volume_size': 1} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1490026876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e62af74-ceb3-4073-be71-10ab85131201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e794cd1e0cfb493cbee7d1cdf551081b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:53:06Z,use_quota=True,user_id='8acbf823e4664d0fbecb5b3443f2c063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ceaa229d-786a-4756-a500-9631626b4f88),volume_type_id=ceaa229d-786a-4756-a500-9631626b4f88)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Creating volume 2e62af74-ceb3-4073-be71-10ab85131201 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:53:05 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e62af74-ceb3-4073-be71-10ab85131201 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:05 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-7bb955e7-904f-45df-a6ef-518beb33d1a0 tempest-SnapshotsActionsTest-538702046 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:53:06 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-7bb955e7-904f-45df-a6ef-518beb33d1a0 tempest-SnapshotsActionsTest-538702046 None] Deleted volume successfully. Nov 04 18:53:06 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e62af74-ceb3-4073-be71-10ab85131201 1073741824 Nov 04 18:53:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7bb955e7-904f-45df-a6ef-518beb33d1a0 tempest-SnapshotsActionsTest-538702046 None] Lock "cinder-72687c70-1ffb-4542-b4c5-dd47f310204b-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:06 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:06 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e62af74-ceb3-4073-be71-10ab85131201 1073741824" returned: 0 in 0.686s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e62af74-ceb3-4073-be71-10ab85131201 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:06 devstack sudo[93693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e62af74-ceb3-4073-be71-10ab85131201 Nov 04 18:53:06 devstack sudo[93693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:06 devstack sudo[93693]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e62af74-ceb3-4073-be71-10ab85131201" returned: 0 in 0.286s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:06 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:53:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20abd54b-0498-4d40-bc97-482c013c08ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e62af74-ceb3-4073-be71-10ab85131201', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246c846b-190a-4ad2-8be9-5b22da2f5322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:07 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Volume volume-2e62af74-ceb3-4073-be71-10ab85131201 (2e62af74-ceb3-4073-be71-10ab85131201): created successfully Nov 04 18:53:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246c846b-190a-4ad2-8be9-5b22da2f5322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Flow 'volume_create_manager' (a83f86a6-e29b-46e1-b5c1-14126cafa662) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:53:07 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-6693089f-4c60-4417-b3fc-0b4121244a12 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Created volume successfully. Nov 04 18:53:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b00bf79b-85f9-46f9-a027-e2a75f53f7a5 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b00bf79b-85f9-46f9-a027-e2a75f53f7a5 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-b00bf79b-85f9-46f9-a027-e2a75f53f7a5 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:53:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-b00bf79b-85f9-46f9-a027-e2a75f53f7a5 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:53:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b00bf79b-85f9-46f9-a027-e2a75f53f7a5 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b00bf79b-85f9-46f9-a027-e2a75f53f7a5 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:08 devstack sudo[93704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:53:08 devstack sudo[93704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:08 devstack sudo[93704]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b00bf79b-85f9-46f9-a027-e2a75f53f7a5 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.286s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:08 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-b00bf79b-85f9-46f9-a027-e2a75f53f7a5 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:53:08 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-b00bf79b-85f9-46f9-a027-e2a75f53f7a5 tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Retype volume completed successfully. Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2186569c-284b-49fd-8641-3a3a5e1d86eb tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Acquiring lock "cinder-2e62af74-ceb3-4073-be71-10ab85131201-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2186569c-284b-49fd-8641-3a3a5e1d86eb tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Lock "cinder-2e62af74-ceb3-4073-be71-10ab85131201-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2186569c-284b-49fd-8641-3a3a5e1d86eb tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Acquiring lock "cinder-quobyte-2e62af74-ceb3-4073-be71-10ab85131201" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2186569c-284b-49fd-8641-3a3a5e1d86eb tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Lock "cinder-quobyte-2e62af74-ceb3-4073-be71-10ab85131201" acquired by "delete_volume" :: waited 0.022s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed33e9d-f237-458e-bbee-c155502e907f]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2186569c-284b-49fd-8641-3a3a5e1d86eb tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e62af74-ceb3-4073-be71-10ab85131201 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Flow 'volume_create_manager' (60263bba-0838-4eb7-a196-13bf1b5f7167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:53:10 devstack sudo[93713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e62af74-ceb3-4073-be71-10ab85131201 Nov 04 18:53:10 devstack sudo[93713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a676f3-e76e-443b-a345-5f26087292f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a676f3-e76e-443b-a345-5f26087292f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-675135546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18a9b918-9479-49e2-917a-b36322723114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0059abb6e9e47e4a92600099aa32018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:53:10Z,use_quota=True,user_id='03f7a7ce52d5444baedd6a567e0e11be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3fd853-2d3e-41c1-b818-9e8d3cca2da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3fd853-2d3e-41c1-b818-9e8d3cca2da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (929ffd4d-de34-4ea3-a5ba-c6ac9cc4b5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (929ffd4d-de34-4ea3-a5ba-c6ac9cc4b5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18a9b918-9479-49e2-917a-b36322723114', 'volume_name': 'volume-18a9b918-9479-49e2-917a-b36322723114', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c117bce0-0ade-4c0c-a5a6-a7635eedc5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c117bce0-0ade-4c0c-a5a6-a7635eedc5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77f91c1a-ca51-4969-a0ec-c1b2d355511e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:10 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Volume 18a9b918-9479-49e2-917a-b36322723114: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18a9b918-9479-49e2-917a-b36322723114', 'volume_size': 1} Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-675135546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18a9b918-9479-49e2-917a-b36322723114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0059abb6e9e47e4a92600099aa32018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:53:10Z,use_quota=True,user_id='03f7a7ce52d5444baedd6a567e0e11be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Creating volume 18a9b918-9479-49e2-917a-b36322723114 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:53:10 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-18a9b918-9479-49e2-917a-b36322723114 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:10 devstack sudo[93715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-18a9b918-9479-49e2-917a-b36322723114 1073741824 Nov 04 18:53:10 devstack sudo[93715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:10 devstack sudo[93713]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2186569c-284b-49fd-8641-3a3a5e1d86eb tempest-VolumeRetypeWithoutMigrationTest-58241795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e62af74-ceb3-4073-be71-10ab85131201" returned: 0 in 0.507s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2186569c-284b-49fd-8641-3a3a5e1d86eb tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e62af74-ceb3-4073-be71-10ab85131201 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:10 devstack sudo[93721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e62af74-ceb3-4073-be71-10ab85131201 Nov 04 18:53:10 devstack sudo[93721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:11 devstack sudo[93721]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2186569c-284b-49fd-8641-3a3a5e1d86eb tempest-VolumeRetypeWithoutMigrationTest-58241795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e62af74-ceb3-4073-be71-10ab85131201" returned: 0 in 0.318s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:11 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2186569c-284b-49fd-8641-3a3a5e1d86eb tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Lock "cinder-quobyte-2e62af74-ceb3-4073-be71-10ab85131201" released by "delete_volume" :: held 0.891s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:11 devstack sudo[93715]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-18a9b918-9479-49e2-917a-b36322723114 1073741824" returned: 0 in 0.646s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:11 devstack cinder-volume[87119]: WARNING cinder.quota [None req-2186569c-284b-49fd-8641-3a3a5e1d86eb tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:53:11 devstack cinder-volume[87119]: WARNING cinder.quota [None req-2186569c-284b-49fd-8641-3a3a5e1d86eb tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:53:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-18a9b918-9479-49e2-917a-b36322723114 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:11 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-2186569c-284b-49fd-8641-3a3a5e1d86eb tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Created reservations ['a0d2e0b1-3eff-4de8-8b18-5ba65813cb59', 'b8489a26-4c00-4c40-880a-0a652868950d', '50459ee0-56d4-4273-8c30-6fe4b775badf', '77bb6841-facc-4081-ae50-f89ea87a0384'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:53:11 devstack sudo[93727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-18a9b918-9479-49e2-917a-b36322723114 Nov 04 18:53:11 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2186569c-284b-49fd-8641-3a3a5e1d86eb tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2186569c-284b-49fd-8641-3a3a5e1d86eb tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:11 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2186569c-284b-49fd-8641-3a3a5e1d86eb tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:53:11 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2186569c-284b-49fd-8641-3a3a5e1d86eb tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:53:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2186569c-284b-49fd-8641-3a3a5e1d86eb tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2186569c-284b-49fd-8641-3a3a5e1d86eb tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:11 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:53:11 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:11 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-18a9b918-9479-49e2-917a-b36322723114" returned: 0 in 0.379s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:11 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:53:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77f91c1a-ca51-4969-a0ec-c1b2d355511e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18a9b918-9479-49e2-917a-b36322723114', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d200f3-3e7d-4c0e-b242-4f41a4047906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:11 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Volume volume-18a9b918-9479-49e2-917a-b36322723114 (18a9b918-9479-49e2-917a-b36322723114): created successfully Nov 04 18:53:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d200f3-3e7d-4c0e-b242-4f41a4047906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Flow 'volume_create_manager' (60263bba-0838-4eb7-a196-13bf1b5f7167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:53:11 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-9c1375b1-e614-48cd-a60e-7928d978d262 tempest-AttachVolumeTestJSON-743042902 None] Created volume successfully. Nov 04 18:53:11 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2186569c-284b-49fd-8641-3a3a5e1d86eb tempest-VolumeRetypeWithoutMigrationTest-58241795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.364s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:11 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-2186569c-284b-49fd-8641-3a3a5e1d86eb tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:53:11 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-2186569c-284b-49fd-8641-3a3a5e1d86eb tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Deleted volume successfully. Nov 04 18:53:11 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2186569c-284b-49fd-8641-3a3a5e1d86eb tempest-VolumeRetypeWithoutMigrationTest-58241795 None] Lock "cinder-2e62af74-ceb3-4073-be71-10ab85131201-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-0a0f3245-4ef1-43de-ac13-2b19a037dca4 req-ca364b84-6212-4ede-94c3-96b0970e48de tempest-AttachVolumeTestJSON-743042902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-0a0f3245-4ef1-43de-ac13-2b19a037dca4 req-ca364b84-6212-4ede-94c3-96b0970e48de tempest-AttachVolumeTestJSON-743042902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-0a0f3245-4ef1-43de-ac13-2b19a037dca4 req-ca364b84-6212-4ede-94c3-96b0970e48de tempest-AttachVolumeTestJSON-743042902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-0a0f3245-4ef1-43de-ac13-2b19a037dca4 req-ca364b84-6212-4ede-94c3-96b0970e48de tempest-AttachVolumeTestJSON-743042902 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280', 'name': 'volume-18a9b918-9479-49e2-917a-b36322723114', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f55f8a5d-4bd6-4161-8559-bb9d9de33889', 'enforce_multipath': True} {{(pid=87119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:53:14 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-0a0f3245-4ef1-43de-ac13-2b19a037dca4 req-ca364b84-6212-4ede-94c3-96b0970e48de tempest-AttachVolumeTestJSON-743042902 None] attachment_update completed successfully. Nov 04 18:53:24 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=32,cinder:INSERT=5,cinder:UPDATE=31,cinder:DELETE=1 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:53:24 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=33,cinder:INSERT=9,cinder:UPDATE=37,cinder:DELETE=3 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:53:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:53:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:53:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:53:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:25 devstack sudo[94711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:53:25 devstack sudo[94711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:25 devstack sudo[94711]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.430s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:25 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:53:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager._thread_info {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:53:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread count: 28 {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:53:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread info: [<_MainThread(MainThread, started 130247852032128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:53:28 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:53:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Flow 'volume_create_manager' (06a8599c-cb32-488b-9111-5205d890ff1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:53:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f524d447-47d0-4811-a2e6-eb8d66db7469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f524d447-47d0-4811-a2e6-eb8d66db7469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1410057682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d45408b8-dfa4-4fd8-8c41-370f986ec810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='324c9a2300884768b27facb3932e58ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:53:28Z,use_quota=True,user_id='08b11a1a6c144953bbfaa18225bae95b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b7570ef-d0e5-423b-acf7-941f1950a2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b7570ef-d0e5-423b-acf7-941f1950a2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8db3f974-9763-407a-b4c6-e03f64f54a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8db3f974-9763-407a-b4c6-e03f64f54a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd45408b8-dfa4-4fd8-8c41-370f986ec810', 'volume_name': 'volume-d45408b8-dfa4-4fd8-8c41-370f986ec810', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37272415-a271-4fe1-8bff-91e29ef08876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37272415-a271-4fe1-8bff-91e29ef08876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd42476d-d63d-4cbd-ae9f-8fdc06ee38d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:28 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Volume d45408b8-dfa4-4fd8-8c41-370f986ec810: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d45408b8-dfa4-4fd8-8c41-370f986ec810', 'volume_size': 1} Nov 04 18:53:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1410057682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d45408b8-dfa4-4fd8-8c41-370f986ec810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='324c9a2300884768b27facb3932e58ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:53:28Z,use_quota=True,user_id='08b11a1a6c144953bbfaa18225bae95b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:53:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Creating volume d45408b8-dfa4-4fd8-8c41-370f986ec810 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:53:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:53:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:53:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:53:28 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:53:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d45408b8-dfa4-4fd8-8c41-370f986ec810 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:28 devstack sudo[94715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d45408b8-dfa4-4fd8-8c41-370f986ec810 1073741824 Nov 04 18:53:28 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:28 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d45408b8-dfa4-4fd8-8c41-370f986ec810 1073741824" returned: 0 in 0.554s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d45408b8-dfa4-4fd8-8c41-370f986ec810 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:29 devstack sudo[94721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d45408b8-dfa4-4fd8-8c41-370f986ec810 Nov 04 18:53:29 devstack sudo[94721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:29 devstack sudo[94721]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d45408b8-dfa4-4fd8-8c41-370f986ec810" returned: 0 in 0.328s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:53:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd42476d-d63d-4cbd-ae9f-8fdc06ee38d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d45408b8-dfa4-4fd8-8c41-370f986ec810', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aecd0d2-36fb-4426-bed9-85e6e2b3da14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:29 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Volume volume-d45408b8-dfa4-4fd8-8c41-370f986ec810 (d45408b8-dfa4-4fd8-8c41-370f986ec810): created successfully Nov 04 18:53:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aecd0d2-36fb-4426-bed9-85e6e2b3da14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Flow 'volume_create_manager' (06a8599c-cb32-488b-9111-5205d890ff1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:53:29 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-04f51d78-754d-4ede-872c-dc723d772e97 tempest-VolumeQuotasNegativeTestJSON-367535174 None] Created volume successfully. Nov 04 18:53:32 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-89f40b07-a99b-4df0-9d68-c2ce73492b9b tempest-VolumeQuotasNegativeTestJSON-367535174 None] Acquiring lock "cinder-d45408b8-dfa4-4fd8-8c41-370f986ec810-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:32 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-89f40b07-a99b-4df0-9d68-c2ce73492b9b tempest-VolumeQuotasNegativeTestJSON-367535174 None] Lock "cinder-d45408b8-dfa4-4fd8-8c41-370f986ec810-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:32 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-89f40b07-a99b-4df0-9d68-c2ce73492b9b tempest-VolumeQuotasNegativeTestJSON-367535174 None] Acquiring lock "cinder-quobyte-d45408b8-dfa4-4fd8-8c41-370f986ec810" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:32 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-89f40b07-a99b-4df0-9d68-c2ce73492b9b tempest-VolumeQuotasNegativeTestJSON-367535174 None] Lock "cinder-quobyte-d45408b8-dfa4-4fd8-8c41-370f986ec810" acquired by "delete_volume" :: waited 0.020s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:32 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[65af4306-89de-477f-8e54-aa57e2b61a41]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-89f40b07-a99b-4df0-9d68-c2ce73492b9b tempest-VolumeQuotasNegativeTestJSON-367535174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d45408b8-dfa4-4fd8-8c41-370f986ec810 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:32 devstack sudo[94725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d45408b8-dfa4-4fd8-8c41-370f986ec810 Nov 04 18:53:32 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:32 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-89f40b07-a99b-4df0-9d68-c2ce73492b9b tempest-VolumeQuotasNegativeTestJSON-367535174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d45408b8-dfa4-4fd8-8c41-370f986ec810" returned: 0 in 0.460s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-89f40b07-a99b-4df0-9d68-c2ce73492b9b tempest-VolumeQuotasNegativeTestJSON-367535174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d45408b8-dfa4-4fd8-8c41-370f986ec810 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:32 devstack sudo[94731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d45408b8-dfa4-4fd8-8c41-370f986ec810 Nov 04 18:53:32 devstack sudo[94731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:33 devstack sudo[94731]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-89f40b07-a99b-4df0-9d68-c2ce73492b9b tempest-VolumeQuotasNegativeTestJSON-367535174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d45408b8-dfa4-4fd8-8c41-370f986ec810" returned: 0 in 0.408s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:33 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-89f40b07-a99b-4df0-9d68-c2ce73492b9b tempest-VolumeQuotasNegativeTestJSON-367535174 None] Lock "cinder-quobyte-d45408b8-dfa4-4fd8-8c41-370f986ec810" released by "delete_volume" :: held 0.926s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:33 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-89f40b07-a99b-4df0-9d68-c2ce73492b9b tempest-VolumeQuotasNegativeTestJSON-367535174 None] Created reservations ['f8ec7418-2fbe-438b-b5b7-985b4b257295', 'cc7bb52f-471d-4d2e-9232-ec280a7c085d', 'f8003276-9b1d-4b5c-b4c2-5efb0178be5b', '7558076b-0c16-4eb8-8ebd-963f18f2fd88'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:53:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-89f40b07-a99b-4df0-9d68-c2ce73492b9b tempest-VolumeQuotasNegativeTestJSON-367535174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-89f40b07-a99b-4df0-9d68-c2ce73492b9b tempest-VolumeQuotasNegativeTestJSON-367535174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-89f40b07-a99b-4df0-9d68-c2ce73492b9b tempest-VolumeQuotasNegativeTestJSON-367535174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:53:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-89f40b07-a99b-4df0-9d68-c2ce73492b9b tempest-VolumeQuotasNegativeTestJSON-367535174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:53:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-89f40b07-a99b-4df0-9d68-c2ce73492b9b tempest-VolumeQuotasNegativeTestJSON-367535174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-89f40b07-a99b-4df0-9d68-c2ce73492b9b tempest-VolumeQuotasNegativeTestJSON-367535174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:33 devstack sudo[94734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:53:33 devstack sudo[94734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:33 devstack sudo[94734]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-89f40b07-a99b-4df0-9d68-c2ce73492b9b tempest-VolumeQuotasNegativeTestJSON-367535174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.297s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:33 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-89f40b07-a99b-4df0-9d68-c2ce73492b9b tempest-VolumeQuotasNegativeTestJSON-367535174 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:53:33 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-89f40b07-a99b-4df0-9d68-c2ce73492b9b tempest-VolumeQuotasNegativeTestJSON-367535174 None] Deleted volume successfully. Nov 04 18:53:34 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-89f40b07-a99b-4df0-9d68-c2ce73492b9b tempest-VolumeQuotasNegativeTestJSON-367535174 None] Lock "cinder-d45408b8-dfa4-4fd8-8c41-370f986ec810-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:35 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:53:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Flow 'volume_create_manager' (d07a07b7-232d-4495-a395-6f49c67730cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:53:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fadcf731-5e59-497c-a7c7-f4a861bca285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fadcf731-5e59-497c-a7c7-f4a861bca285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1197982497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8aa4313-8f9c-4fcc-b3fa-20b078e7f18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dd2b41319564e84ad78742852db543f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:53:35Z,use_quota=True,user_id='78fb26afbc644a6a86015ab9aa5cccc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d09abf0e-3fc7-47c9-b596-a7d8f5853fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d09abf0e-3fc7-47c9-b596-a7d8f5853fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebebe565-8517-42e1-b2b7-d490f1d880c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebebe565-8517-42e1-b2b7-d490f1d880c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8aa4313-8f9c-4fcc-b3fa-20b078e7f18d', 'volume_name': 'volume-c8aa4313-8f9c-4fcc-b3fa-20b078e7f18d', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f7f605-f835-4e99-9638-709f7ad9353d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f7f605-f835-4e99-9638-709f7ad9353d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62fde319-a8cd-4b1a-9641-b616fdcedc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:35 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Volume c8aa4313-8f9c-4fcc-b3fa-20b078e7f18d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8aa4313-8f9c-4fcc-b3fa-20b078e7f18d', 'volume_size': 1} Nov 04 18:53:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:35 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1197982497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8aa4313-8f9c-4fcc-b3fa-20b078e7f18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dd2b41319564e84ad78742852db543f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:53:35Z,use_quota=True,user_id='78fb26afbc644a6a86015ab9aa5cccc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:53:35 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Creating volume c8aa4313-8f9c-4fcc-b3fa-20b078e7f18d {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:53:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:35 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:53:35 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:53:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:35 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:53:35 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:53:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c8aa4313-8f9c-4fcc-b3fa-20b078e7f18d 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:35 devstack sudo[94751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c8aa4313-8f9c-4fcc-b3fa-20b078e7f18d 1073741824 Nov 04 18:53:35 devstack sudo[94751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:36 devstack sudo[94751]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c8aa4313-8f9c-4fcc-b3fa-20b078e7f18d 1073741824" returned: 0 in 0.563s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c8aa4313-8f9c-4fcc-b3fa-20b078e7f18d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:36 devstack sudo[94757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c8aa4313-8f9c-4fcc-b3fa-20b078e7f18d Nov 04 18:53:36 devstack sudo[94757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:36 devstack sudo[94757]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c8aa4313-8f9c-4fcc-b3fa-20b078e7f18d" returned: 0 in 0.264s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:36 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:53:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62fde319-a8cd-4b1a-9641-b616fdcedc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8aa4313-8f9c-4fcc-b3fa-20b078e7f18d', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22c70524-d97f-4909-8472-ffbbae0aa63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:36 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Volume volume-c8aa4313-8f9c-4fcc-b3fa-20b078e7f18d (c8aa4313-8f9c-4fcc-b3fa-20b078e7f18d): created successfully Nov 04 18:53:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22c70524-d97f-4909-8472-ffbbae0aa63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Flow 'volume_create_manager' (d07a07b7-232d-4495-a395-6f49c67730cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:53:36 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-5a1a8b41-22fc-4256-966b-7f6b2184b148 tempest-VolumesMetadataTest-810547432 None] Created volume successfully. Nov 04 18:53:38 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:53:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Flow 'volume_create_manager' (52dda159-826f-4df6-8516-1872c306a9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:53:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7454e2ed-2747-4311-a5f5-3152ac842dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f32fc4ce-bab6-4893-a1e8-a4abde91d52e tempest-VolumesMetadataTest-810547432 None] Acquiring lock "cinder-c8aa4313-8f9c-4fcc-b3fa-20b078e7f18d-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7454e2ed-2747-4311-a5f5-3152ac842dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-106008391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e982117b-0088-4910-8425-063d152e682c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e1c1235e4a471a8fda7f581bb4910a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:53:38Z,use_quota=True,user_id='a3f0b3bc4420476abc070cd2037445eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d454e0a0-95d5-44a4-8a38-0bcfab1905ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d454e0a0-95d5-44a4-8a38-0bcfab1905ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d22e58d-070c-4511-bc94-e5169d8a62dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d22e58d-070c-4511-bc94-e5169d8a62dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e982117b-0088-4910-8425-063d152e682c', 'volume_name': 'volume-e982117b-0088-4910-8425-063d152e682c', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c591d3-bd4c-46db-afee-bae494642e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c591d3-bd4c-46db-afee-bae494642e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f37202-fd8d-4b0f-a8f7-79f2cac41a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:38 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Volume e982117b-0088-4910-8425-063d152e682c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e982117b-0088-4910-8425-063d152e682c', 'volume_size': 1} Nov 04 18:53:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-106008391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e982117b-0088-4910-8425-063d152e682c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e1c1235e4a471a8fda7f581bb4910a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:53:38Z,use_quota=True,user_id='a3f0b3bc4420476abc070cd2037445eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:53:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Creating volume e982117b-0088-4910-8425-063d152e682c {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:53:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:53:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:53:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:53:38 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:53:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e982117b-0088-4910-8425-063d152e682c 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f32fc4ce-bab6-4893-a1e8-a4abde91d52e tempest-VolumesMetadataTest-810547432 None] Lock "cinder-c8aa4313-8f9c-4fcc-b3fa-20b078e7f18d-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:38 devstack sudo[94761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e982117b-0088-4910-8425-063d152e682c 1073741824 Nov 04 18:53:38 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f32fc4ce-bab6-4893-a1e8-a4abde91d52e tempest-VolumesMetadataTest-810547432 None] Acquiring lock "cinder-quobyte-c8aa4313-8f9c-4fcc-b3fa-20b078e7f18d" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f32fc4ce-bab6-4893-a1e8-a4abde91d52e tempest-VolumesMetadataTest-810547432 None] Lock "cinder-quobyte-c8aa4313-8f9c-4fcc-b3fa-20b078e7f18d" acquired by "delete_volume" :: waited 0.022s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:38 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe7deab-871c-40e0-a589-8b8b81537dbd]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f32fc4ce-bab6-4893-a1e8-a4abde91d52e tempest-VolumesMetadataTest-810547432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c8aa4313-8f9c-4fcc-b3fa-20b078e7f18d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:38 devstack sudo[94763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c8aa4313-8f9c-4fcc-b3fa-20b078e7f18d Nov 04 18:53:38 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:39 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e982117b-0088-4910-8425-063d152e682c 1073741824" returned: 0 in 0.469s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:39 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f32fc4ce-bab6-4893-a1e8-a4abde91d52e tempest-VolumesMetadataTest-810547432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c8aa4313-8f9c-4fcc-b3fa-20b078e7f18d" returned: 0 in 0.381s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f32fc4ce-bab6-4893-a1e8-a4abde91d52e tempest-VolumesMetadataTest-810547432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c8aa4313-8f9c-4fcc-b3fa-20b078e7f18d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e982117b-0088-4910-8425-063d152e682c {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:39 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c8aa4313-8f9c-4fcc-b3fa-20b078e7f18d Nov 04 18:53:39 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:39 devstack sudo[94774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e982117b-0088-4910-8425-063d152e682c Nov 04 18:53:39 devstack sudo[94774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:39 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:39 devstack sudo[94774]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f32fc4ce-bab6-4893-a1e8-a4abde91d52e tempest-VolumesMetadataTest-810547432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c8aa4313-8f9c-4fcc-b3fa-20b078e7f18d" returned: 0 in 0.282s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e982117b-0088-4910-8425-063d152e682c" returned: 0 in 0.269s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:39 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:53:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:39 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f32fc4ce-bab6-4893-a1e8-a4abde91d52e tempest-VolumesMetadataTest-810547432 None] Lock "cinder-quobyte-c8aa4313-8f9c-4fcc-b3fa-20b078e7f18d" released by "delete_volume" :: held 0.715s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:39 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f37202-fd8d-4b0f-a8f7-79f2cac41a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e982117b-0088-4910-8425-063d152e682c', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:39 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721a9f8c-574f-4908-b5aa-d48b5cf88da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:39 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Volume volume-e982117b-0088-4910-8425-063d152e682c (e982117b-0088-4910-8425-063d152e682c): created successfully Nov 04 18:53:39 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721a9f8c-574f-4908-b5aa-d48b5cf88da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:39 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Flow 'volume_create_manager' (52dda159-826f-4df6-8516-1872c306a9a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:53:39 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-f6c8ed9e-bfc9-4d5f-82ff-c68004add40b tempest-VolumeQuotasAdminTestJSON-1974685755 None] Created volume successfully. Nov 04 18:53:39 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-f32fc4ce-bab6-4893-a1e8-a4abde91d52e tempest-VolumesMetadataTest-810547432 None] Created reservations ['51f530f5-dbf1-42fe-b0b4-c1d17892d675', '6ed66553-4532-42cc-8b30-e9bfc76fb0c9', 'af9c9e93-5a66-4785-b9b6-dd02f4d60712', '35f5d0e0-d54f-49fe-9b85-3236d63971fa'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:53:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f32fc4ce-bab6-4893-a1e8-a4abde91d52e tempest-VolumesMetadataTest-810547432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f32fc4ce-bab6-4893-a1e8-a4abde91d52e tempest-VolumesMetadataTest-810547432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:39 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f32fc4ce-bab6-4893-a1e8-a4abde91d52e tempest-VolumesMetadataTest-810547432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:53:39 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f32fc4ce-bab6-4893-a1e8-a4abde91d52e tempest-VolumesMetadataTest-810547432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:53:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f32fc4ce-bab6-4893-a1e8-a4abde91d52e tempest-VolumesMetadataTest-810547432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f32fc4ce-bab6-4893-a1e8-a4abde91d52e tempest-VolumesMetadataTest-810547432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:39 devstack sudo[94802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:53:39 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:39 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f32fc4ce-bab6-4893-a1e8-a4abde91d52e tempest-VolumesMetadataTest-810547432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.280s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:39 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-f32fc4ce-bab6-4893-a1e8-a4abde91d52e tempest-VolumesMetadataTest-810547432 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:53:39 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-f32fc4ce-bab6-4893-a1e8-a4abde91d52e tempest-VolumesMetadataTest-810547432 None] Deleted volume successfully. Nov 04 18:53:39 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f32fc4ce-bab6-4893-a1e8-a4abde91d52e tempest-VolumesMetadataTest-810547432 None] Lock "cinder-c8aa4313-8f9c-4fcc-b3fa-20b078e7f18d-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9769b74a-f508-4297-b214-73af71069b89 tempest-VolumeQuotasAdminTestJSON-1974685755 None] Acquiring lock "cinder-e982117b-0088-4910-8425-063d152e682c-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9769b74a-f508-4297-b214-73af71069b89 tempest-VolumeQuotasAdminTestJSON-1974685755 None] Lock "cinder-e982117b-0088-4910-8425-063d152e682c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9769b74a-f508-4297-b214-73af71069b89 tempest-VolumeQuotasAdminTestJSON-1974685755 None] Acquiring lock "cinder-quobyte-e982117b-0088-4910-8425-063d152e682c" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9769b74a-f508-4297-b214-73af71069b89 tempest-VolumeQuotasAdminTestJSON-1974685755 None] Lock "cinder-quobyte-e982117b-0088-4910-8425-063d152e682c" acquired by "delete_volume" :: waited 0.014s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:40 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4db1e57-f7d7-43d0-877a-947da944510b]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9769b74a-f508-4297-b214-73af71069b89 tempest-VolumeQuotasAdminTestJSON-1974685755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e982117b-0088-4910-8425-063d152e682c {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:40 devstack sudo[94805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e982117b-0088-4910-8425-063d152e682c Nov 04 18:53:40 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:41 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9769b74a-f508-4297-b214-73af71069b89 tempest-VolumeQuotasAdminTestJSON-1974685755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e982117b-0088-4910-8425-063d152e682c" returned: 0 in 0.448s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9769b74a-f508-4297-b214-73af71069b89 tempest-VolumeQuotasAdminTestJSON-1974685755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e982117b-0088-4910-8425-063d152e682c {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:41 devstack sudo[94811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e982117b-0088-4910-8425-063d152e682c Nov 04 18:53:41 devstack sudo[94811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:41 devstack sudo[94811]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9769b74a-f508-4297-b214-73af71069b89 tempest-VolumeQuotasAdminTestJSON-1974685755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e982117b-0088-4910-8425-063d152e682c" returned: 0 in 0.298s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:41 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9769b74a-f508-4297-b214-73af71069b89 tempest-VolumeQuotasAdminTestJSON-1974685755 None] Lock "cinder-quobyte-e982117b-0088-4910-8425-063d152e682c" released by "delete_volume" :: held 0.810s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:41 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-9769b74a-f508-4297-b214-73af71069b89 tempest-VolumeQuotasAdminTestJSON-1974685755 None] Created reservations ['2b00a204-59ae-41a7-98be-75888933b409', '3ee51c1a-a691-4e3c-97ff-bd394537f1b5', 'e9e6da07-5d3f-4fca-8b1f-e177a37787da', 'b0d9ede9-5834-4ce2-ab7e-59af593ccc7b'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:53:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9769b74a-f508-4297-b214-73af71069b89 tempest-VolumeQuotasAdminTestJSON-1974685755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9769b74a-f508-4297-b214-73af71069b89 tempest-VolumeQuotasAdminTestJSON-1974685755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:41 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9769b74a-f508-4297-b214-73af71069b89 tempest-VolumeQuotasAdminTestJSON-1974685755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:53:41 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9769b74a-f508-4297-b214-73af71069b89 tempest-VolumeQuotasAdminTestJSON-1974685755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:53:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9769b74a-f508-4297-b214-73af71069b89 tempest-VolumeQuotasAdminTestJSON-1974685755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9769b74a-f508-4297-b214-73af71069b89 tempest-VolumeQuotasAdminTestJSON-1974685755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:41 devstack sudo[94814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:53:41 devstack sudo[94814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:42 devstack sudo[94814]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9769b74a-f508-4297-b214-73af71069b89 tempest-VolumeQuotasAdminTestJSON-1974685755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.355s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:42 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-9769b74a-f508-4297-b214-73af71069b89 tempest-VolumeQuotasAdminTestJSON-1974685755 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:53:42 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-9769b74a-f508-4297-b214-73af71069b89 tempest-VolumeQuotasAdminTestJSON-1974685755 None] Deleted volume successfully. Nov 04 18:53:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9769b74a-f508-4297-b214-73af71069b89 tempest-VolumeQuotasAdminTestJSON-1974685755 None] Lock "cinder-e982117b-0088-4910-8425-063d152e682c-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:42 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:53:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Flow 'volume_create_manager' (ebda8b35-e70f-492f-bb4c-9c4588889907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:53:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc34410-e997-41f9-abae-95ef3e011f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc34410-e997-41f9-abae-95ef3e011f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1986605353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=343403e3-b332-4c8e-9b1e-6aa077870418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82c746b756a4a9c853792a6fac24c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:53:43Z,use_quota=True,user_id='7170b545a5914d1b8df886d4460c0847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3798e35-b41e-4fbb-814f-205d389d545e),volume_type_id=c3798e35-b41e-4fbb-814f-205d389d545e)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88d810a8-b459-40f6-bd51-98ba532dff81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88d810a8-b459-40f6-bd51-98ba532dff81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80601ea6-c1f7-4b6e-9eb9-355ba9832a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80601ea6-c1f7-4b6e-9eb9-355ba9832a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '343403e3-b332-4c8e-9b1e-6aa077870418', 'volume_name': 'volume-343403e3-b332-4c8e-9b1e-6aa077870418', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be768a69-dbd0-496b-8ff1-eb39f8b22a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be768a69-dbd0-496b-8ff1-eb39f8b22a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (465a4c94-6d7f-47c2-af48-b61d4d9b6a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:42 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Volume 343403e3-b332-4c8e-9b1e-6aa077870418: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-343403e3-b332-4c8e-9b1e-6aa077870418', 'volume_size': 1} Nov 04 18:53:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:42 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1986605353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=343403e3-b332-4c8e-9b1e-6aa077870418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82c746b756a4a9c853792a6fac24c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:53:43Z,use_quota=True,user_id='7170b545a5914d1b8df886d4460c0847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3798e35-b41e-4fbb-814f-205d389d545e),volume_type_id=c3798e35-b41e-4fbb-814f-205d389d545e)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:53:42 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Creating volume 343403e3-b332-4c8e-9b1e-6aa077870418 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:53:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:42 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:53:42 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:53:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:42 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:53:42 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:53:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-343403e3-b332-4c8e-9b1e-6aa077870418 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:42 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-343403e3-b332-4c8e-9b1e-6aa077870418 1073741824 Nov 04 18:53:42 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:42 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:53:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Flow 'volume_create_manager' (ec07577b-266f-40d0-a005-19e6bee99356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:53:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4b98be-d1d1-4ebb-975c-ef021ff4f013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4b98be-d1d1-4ebb-975c-ef021ff4f013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1814168946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e98811f1-fa47-4b40-9644-16f349370158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e1c1235e4a471a8fda7f581bb4910a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:53:43Z,use_quota=True,user_id='a3f0b3bc4420476abc070cd2037445eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f30b2cd-6065-453f-b3d6-cc0a5e27a8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f30b2cd-6065-453f-b3d6-cc0a5e27a8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd351747-8f94-4f0f-b967-cf38198842b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd351747-8f94-4f0f-b967-cf38198842b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e98811f1-fa47-4b40-9644-16f349370158', 'volume_name': 'volume-e98811f1-fa47-4b40-9644-16f349370158', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f39bc3-7e0c-44bd-9bc9-b0bf1ebb83c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f39bc3-7e0c-44bd-9bc9-b0bf1ebb83c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ac1200-e41f-4b9c-bfba-3b61eac3e46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:43 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Volume e98811f1-fa47-4b40-9644-16f349370158: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e98811f1-fa47-4b40-9644-16f349370158', 'volume_size': 1} Nov 04 18:53:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:43 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-343403e3-b332-4c8e-9b1e-6aa077870418 1073741824" returned: 0 in 0.565s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-343403e3-b332-4c8e-9b1e-6aa077870418 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:43 devstack sudo[94859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-343403e3-b332-4c8e-9b1e-6aa077870418 Nov 04 18:53:43 devstack sudo[94859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:43 devstack sudo[94859]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-343403e3-b332-4c8e-9b1e-6aa077870418" returned: 0 in 0.277s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:43 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:53:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.663s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:43 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1814168946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e98811f1-fa47-4b40-9644-16f349370158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e1c1235e4a471a8fda7f581bb4910a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:53:43Z,use_quota=True,user_id='a3f0b3bc4420476abc070cd2037445eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:53:43 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Creating volume e98811f1-fa47-4b40-9644-16f349370158 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:53:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:43 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:53:43 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:53:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:43 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:53:43 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:53:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e98811f1-fa47-4b40-9644-16f349370158 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:43 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e98811f1-fa47-4b40-9644-16f349370158 1073741824 Nov 04 18:53:43 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (465a4c94-6d7f-47c2-af48-b61d4d9b6a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-343403e3-b332-4c8e-9b1e-6aa077870418', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a956bf60-249e-4f2b-ac44-d8775dc7b3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:43 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Volume volume-343403e3-b332-4c8e-9b1e-6aa077870418 (343403e3-b332-4c8e-9b1e-6aa077870418): created successfully Nov 04 18:53:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a956bf60-249e-4f2b-ac44-d8775dc7b3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Flow 'volume_create_manager' (ebda8b35-e70f-492f-bb4c-9c4588889907) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:53:43 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-82950cb2-14db-4dd5-a1be-ccceafb6c4fd tempest-VolumeTypesAccessTest-1867678243 None] Created volume successfully. Nov 04 18:53:44 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e98811f1-fa47-4b40-9644-16f349370158 1073741824" returned: 0 in 0.471s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e98811f1-fa47-4b40-9644-16f349370158 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:44 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e98811f1-fa47-4b40-9644-16f349370158 Nov 04 18:53:44 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:44 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e98811f1-fa47-4b40-9644-16f349370158" returned: 0 in 0.280s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:44 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:53:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:44 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ac1200-e41f-4b9c-bfba-3b61eac3e46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e98811f1-fa47-4b40-9644-16f349370158', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:44 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e2c0c05-11e3-422e-9ab8-e4d34180857b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:44 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Volume volume-e98811f1-fa47-4b40-9644-16f349370158 (e98811f1-fa47-4b40-9644-16f349370158): created successfully Nov 04 18:53:44 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e2c0c05-11e3-422e-9ab8-e4d34180857b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:44 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Flow 'volume_create_manager' (ec07577b-266f-40d0-a005-19e6bee99356) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:53:44 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-d907f3bb-d2f5-4610-ab70-c5ec0491833e tempest-VolumeQuotasAdminTestJSON-1974685755 None] Created volume successfully. Nov 04 18:53:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e72afdd6-e25e-4326-97be-ba1474e10145 tempest-VolumeTypesAccessTest-1867678243 None] Acquiring lock "cinder-343403e3-b332-4c8e-9b1e-6aa077870418-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e72afdd6-e25e-4326-97be-ba1474e10145 tempest-VolumeTypesAccessTest-1867678243 None] Lock "cinder-343403e3-b332-4c8e-9b1e-6aa077870418-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e72afdd6-e25e-4326-97be-ba1474e10145 tempest-VolumeTypesAccessTest-1867678243 None] Acquiring lock "cinder-quobyte-343403e3-b332-4c8e-9b1e-6aa077870418" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e72afdd6-e25e-4326-97be-ba1474e10145 tempest-VolumeTypesAccessTest-1867678243 None] Lock "cinder-quobyte-343403e3-b332-4c8e-9b1e-6aa077870418" acquired by "delete_volume" :: waited 0.025s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:45 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c5799e-69c1-4051-8d59-f27aa100b8c4]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e72afdd6-e25e-4326-97be-ba1474e10145 tempest-VolumeTypesAccessTest-1867678243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-343403e3-b332-4c8e-9b1e-6aa077870418 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:45 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-eafc57c7-669f-4922-8ee4-70c201747cfd req-dbeec033-fbc1-408a-aabd-0eb10859909d tempest-AttachVolumeTestJSON-743042902 None] Terminate volume connection completed successfully. Nov 04 18:53:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-eafc57c7-669f-4922-8ee4-70c201747cfd req-dbeec033-fbc1-408a-aabd-0eb10859909d tempest-AttachVolumeTestJSON-743042902 None] Deleting attachment f55f8a5d-4bd6-4161-8559-bb9d9de33889. {{(pid=87119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:53:45 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:53:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Flow 'volume_create_manager' (14c3f2d4-8958-4201-8f79-1f9b249d5b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:53:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6973158a-c6d1-41de-a64a-8653ec19d944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:45 devstack sudo[94877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-343403e3-b332-4c8e-9b1e-6aa077870418 Nov 04 18:53:45 devstack sudo[94877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6973158a-c6d1-41de-a64a-8653ec19d944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-368101920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52481c63-555a-4f21-b619-feeba33c8982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092fb425dea64db59cc35c6202c0ca84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:53:45Z,use_quota=True,user_id='10a1451ed9394206a1719a09cb9ca0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f552a53-9478-43fe-aa90-2e5344dc3c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f552a53-9478-43fe-aa90-2e5344dc3c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c1759a5-e293-4175-b3b2-9be8302200d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:45 devstack cinder-volume[87119]: DEBUG cinder.image.glance [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Creating Keystone auth plugin from conf {{(pid=87119) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 18:53:45 devstack sudo[94877]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e72afdd6-e25e-4326-97be-ba1474e10145 tempest-VolumeTypesAccessTest-1867678243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-343403e3-b332-4c8e-9b1e-6aa077870418" returned: 0 in 0.440s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e72afdd6-e25e-4326-97be-ba1474e10145 tempest-VolumeTypesAccessTest-1867678243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-343403e3-b332-4c8e-9b1e-6aa077870418 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:45 devstack sudo[94883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-343403e3-b332-4c8e-9b1e-6aa077870418 Nov 04 18:53:45 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c1759a5-e293-4175-b3b2-9be8302200d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '52481c63-555a-4f21-b619-feeba33c8982', 'volume_name': 'volume-52481c63-555a-4f21-b619-feeba33c8982', 'volume_size': 1, 'image_id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '184bff60e125442790f1bc12f0dfbe3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'created_at': datetime.datetime(2026, 11, 4, 17, 42, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (060696c9-08a8-487b-ade2-cb00f8a5bdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (060696c9-08a8-487b-ade2-cb00f8a5bdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13cc562c-2a55-4b36-ae54-b903d658b98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:45 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Volume 52481c63-555a-4f21-b619-feeba33c8982: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-52481c63-555a-4f21-b619-feeba33c8982', 'volume_size': 1, 'image_id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '184bff60e125442790f1bc12f0dfbe3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'created_at': datetime.datetime(2026, 11, 4, 17, 42, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 18:53:45 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Trying to clone 52481c63-555a-4f21-b619-feeba33c8982 from image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d at location (None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}]). {{(pid=87119) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 18:53:45 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e72afdd6-e25e-4326-97be-ba1474e10145 tempest-VolumeTypesAccessTest-1867678243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-343403e3-b332-4c8e-9b1e-6aa077870418" returned: 0 in 0.419s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e72afdd6-e25e-4326-97be-ba1474e10145 tempest-VolumeTypesAccessTest-1867678243 None] Lock "cinder-quobyte-343403e3-b332-4c8e-9b1e-6aa077870418" released by "delete_volume" :: held 0.951s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:45 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_swibhh5ndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 18:53:45 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Image download 20.69 MB at 20.69 MB/s Nov 04 18:53:46 devstack cinder-volume[87119]: WARNING cinder.quota [None req-e72afdd6-e25e-4326-97be-ba1474e10145 tempest-VolumeTypesAccessTest-1867678243 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-950783518 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-950783518, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:53:46 devstack cinder-volume[87119]: WARNING cinder.quota [None req-e72afdd6-e25e-4326-97be-ba1474e10145 tempest-VolumeTypesAccessTest-1867678243 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-950783518 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-950783518, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:53:46 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-e72afdd6-e25e-4326-97be-ba1474e10145 tempest-VolumeTypesAccessTest-1867678243 None] Created reservations ['366e9c6c-c50d-469a-a2bd-f7cdd8b4a9f9', '220ec095-1b9e-466c-9c87-1a6d79ec991a', '2ac2d8a6-cd8b-438e-8d4a-a6a94de2f132', '759a0f5a-e7ec-422b-847a-1a533092db1e'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:53:46 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb0f6fb-fa75-401f-83d3-8ae6401082de]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_swibhh5ndevstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:46 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-d667fbd0-1b35-4b4b-af1d-07bb0da2ebb8 tempest-VolumeQuotasAdminTestJSON-2028639272 None] Transfer volume completed successfully. Nov 04 18:53:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e72afdd6-e25e-4326-97be-ba1474e10145 tempest-VolumeTypesAccessTest-1867678243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e72afdd6-e25e-4326-97be-ba1474e10145 tempest-VolumeTypesAccessTest-1867678243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e72afdd6-e25e-4326-97be-ba1474e10145 tempest-VolumeTypesAccessTest-1867678243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:53:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e72afdd6-e25e-4326-97be-ba1474e10145 tempest-VolumeTypesAccessTest-1867678243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:53:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e72afdd6-e25e-4326-97be-ba1474e10145 tempest-VolumeTypesAccessTest-1867678243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e72afdd6-e25e-4326-97be-ba1474e10145 tempest-VolumeTypesAccessTest-1867678243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:46 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:53:46 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:46 devstack sudo[94888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_swibhh5ndevstack@QuobyteHD Nov 04 18:53:46 devstack sudo[94888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:46 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e72afdd6-e25e-4326-97be-ba1474e10145 tempest-VolumeTypesAccessTest-1867678243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.385s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:46 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-e72afdd6-e25e-4326-97be-ba1474e10145 tempest-VolumeTypesAccessTest-1867678243 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:53:46 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e72afdd6-e25e-4326-97be-ba1474e10145 tempest-VolumeTypesAccessTest-1867678243 None] Deleted volume successfully. Nov 04 18:53:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e72afdd6-e25e-4326-97be-ba1474e10145 tempest-VolumeTypesAccessTest-1867678243 None] Lock "cinder-343403e3-b332-4c8e-9b1e-6aa077870418-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:46 devstack sudo[94888]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_swibhh5ndevstack@QuobyteHD" returned: 0 in 0.614s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:46 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Temporary image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d is fetched for user 10a1451ed9394206a1719a09cb9ca0db. {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 18:53:46 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b75d5ea-2e90-454d-a96a-222a54953e49]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_swibhh5ndevstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f355c3a9-6b09-4c69-bfb6-2d73a6f06ff1 tempest-VolumeQuotasAdminTestJSON-1212701692 None] Acquiring lock "cinder-e98811f1-fa47-4b40-9644-16f349370158-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f355c3a9-6b09-4c69-bfb6-2d73a6f06ff1 tempest-VolumeQuotasAdminTestJSON-1212701692 None] Lock "cinder-e98811f1-fa47-4b40-9644-16f349370158-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f355c3a9-6b09-4c69-bfb6-2d73a6f06ff1 tempest-VolumeQuotasAdminTestJSON-1212701692 None] Acquiring lock "cinder-quobyte-e98811f1-fa47-4b40-9644-16f349370158" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f355c3a9-6b09-4c69-bfb6-2d73a6f06ff1 tempest-VolumeQuotasAdminTestJSON-1212701692 None] Lock "cinder-quobyte-e98811f1-fa47-4b40-9644-16f349370158" acquired by "delete_volume" :: waited 0.029s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:46 devstack sudo[94901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_swibhh5ndevstack@QuobyteHD Nov 04 18:53:46 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:46 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[56151124-9d08-4d00-aa1d-441a4cd5e604]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f355c3a9-6b09-4c69-bfb6-2d73a6f06ff1 tempest-VolumeQuotasAdminTestJSON-1212701692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e98811f1-fa47-4b40-9644-16f349370158 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:47 devstack sudo[94903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e98811f1-fa47-4b40-9644-16f349370158 Nov 04 18:53:47 devstack sudo[94903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:47 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_swibhh5ndevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-368101920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52481c63-555a-4f21-b619-feeba33c8982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092fb425dea64db59cc35c6202c0ca84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:53:45Z,use_quota=True,user_id='10a1451ed9394206a1719a09cb9ca0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:53:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Creating volume 52481c63-555a-4f21-b619-feeba33c8982 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:53:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:53:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:53:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:53:47 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:53:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-52481c63-555a-4f21-b619-feeba33c8982 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:47 devstack sudo[94908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-52481c63-555a-4f21-b619-feeba33c8982 1073741824 Nov 04 18:53:47 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:47 devstack sudo[94903]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f355c3a9-6b09-4c69-bfb6-2d73a6f06ff1 tempest-VolumeQuotasAdminTestJSON-1212701692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e98811f1-fa47-4b40-9644-16f349370158" returned: 0 in 0.385s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f355c3a9-6b09-4c69-bfb6-2d73a6f06ff1 tempest-VolumeQuotasAdminTestJSON-1212701692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e98811f1-fa47-4b40-9644-16f349370158 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:47 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e98811f1-fa47-4b40-9644-16f349370158 Nov 04 18:53:47 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:47 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f355c3a9-6b09-4c69-bfb6-2d73a6f06ff1 tempest-VolumeQuotasAdminTestJSON-1212701692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e98811f1-fa47-4b40-9644-16f349370158" returned: 0 in 0.332s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:47 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f355c3a9-6b09-4c69-bfb6-2d73a6f06ff1 tempest-VolumeQuotasAdminTestJSON-1212701692 None] Lock "cinder-quobyte-e98811f1-fa47-4b40-9644-16f349370158" released by "delete_volume" :: held 0.766s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:47 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-f355c3a9-6b09-4c69-bfb6-2d73a6f06ff1 tempest-VolumeQuotasAdminTestJSON-1212701692 None] Created reservations ['30dd767a-62c2-4119-9e99-7a8a8f6a2569', '7c3d1f88-6030-4720-b9d5-07d117c80480', 'f124b15b-04e3-405f-b3da-a2962ebce9ed', '04b41f4a-b311-4123-a4c8-5d6460c11e0c'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:53:47 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-52481c63-555a-4f21-b619-feeba33c8982 1073741824" returned: 0 in 0.565s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-52481c63-555a-4f21-b619-feeba33c8982 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:47 devstack sudo[94920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-52481c63-555a-4f21-b619-feeba33c8982 Nov 04 18:53:47 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f355c3a9-6b09-4c69-bfb6-2d73a6f06ff1 tempest-VolumeQuotasAdminTestJSON-1212701692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f355c3a9-6b09-4c69-bfb6-2d73a6f06ff1 tempest-VolumeQuotasAdminTestJSON-1212701692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f355c3a9-6b09-4c69-bfb6-2d73a6f06ff1 tempest-VolumeQuotasAdminTestJSON-1212701692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:53:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f355c3a9-6b09-4c69-bfb6-2d73a6f06ff1 tempest-VolumeQuotasAdminTestJSON-1212701692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:53:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f355c3a9-6b09-4c69-bfb6-2d73a6f06ff1 tempest-VolumeQuotasAdminTestJSON-1212701692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f355c3a9-6b09-4c69-bfb6-2d73a6f06ff1 tempest-VolumeQuotasAdminTestJSON-1212701692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:47 devstack sudo[94923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:53:47 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:48 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-52481c63-555a-4f21-b619-feeba33c8982" returned: 0 in 0.402s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:53:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:48 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f355c3a9-6b09-4c69-bfb6-2d73a6f06ff1 tempest-VolumeQuotasAdminTestJSON-1212701692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.361s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:48 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-f355c3a9-6b09-4c69-bfb6-2d73a6f06ff1 tempest-VolumeQuotasAdminTestJSON-1212701692 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:53:48 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-f355c3a9-6b09-4c69-bfb6-2d73a6f06ff1 tempest-VolumeQuotasAdminTestJSON-1212701692 None] Deleted volume successfully. Nov 04 18:53:48 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Attempting download of 1353e8e0-d342-427e-a3b6-10b6f6b08d2d ((None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}])) to volume 52481c63-555a-4f21-b619-feeba33c8982. {{(pid=87119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 18:53:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f355c3a9-6b09-4c69-bfb6-2d73a6f06ff1 tempest-VolumeQuotasAdminTestJSON-1212701692 None] Lock "cinder-e98811f1-fa47-4b40-9644-16f349370158-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:48 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09b86cd-2005-4de7-a3fe-6c8825b2f8e9]: (4, 'raw') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_yua7ysxn {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:48 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_yua7ysxn Nov 04 18:53:48 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:48 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_yua7ysxn" returned: 0 in 0.501s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_yua7ysxn {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:49 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_yua7ysxn Nov 04 18:53:49 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:49 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_yua7ysxn" returned: 1 in 0.541s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_yua7ysxn' failed. Not Retrying. {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 18:53:49 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d55ecbc-a0f6-4489-b0ed-64d60cd04d8e]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_swibhh5ndevstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:49 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_swibhh5ndevstack@QuobyteHD Nov 04 18:53:49 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:49 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_swibhh5ndevstack@QuobyteHD" returned: 0 in 0.521s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:49 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] 1353e8e0-d342-427e-a3b6-10b6f6b08d2d was qcow2, converting to qcow2 {{(pid=87119) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 18:53:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_swibhh5ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-52481c63-555a-4f21-b619-feeba33c8982 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:50 devstack sudo[94961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_swibhh5ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-52481c63-555a-4f21-b619-feeba33c8982 Nov 04 18:53:50 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:53 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_swibhh5ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-52481c63-555a-4f21-b619-feeba33c8982" returned: 0 in 3.390s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:53 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_swibhh5ndevstack@QuobyteHD, size 112.00 MB, duration 3.39 sec, destination /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-52481c63-555a-4f21-b619-feeba33c8982 {{(pid=87119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 18:53:53 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Converted 112.00 MB image at 33.03 MB/s Nov 04 18:53:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-52481c63-555a-4f21-b619-feeba33c8982 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:53 devstack sudo[95046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-52481c63-555a-4f21-b619-feeba33c8982 1G Nov 04 18:53:53 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:53 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-52481c63-555a-4f21-b619-feeba33c8982 1G" returned: 0 in 0.441s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:53 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Downloaded image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d ((None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}])) to volume 52481c63-555a-4f21-b619-feeba33c8982 successfully. {{(pid=87119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 18:53:53 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Temporary image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d for user 10a1451ed9394206a1719a09cb9ca0db is deleted. {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 18:53:53 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Marking volume 52481c63-555a-4f21-b619-feeba33c8982 as bootable. {{(pid=87119) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 18:53:53 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Copying metadata from image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d to 52481c63-555a-4f21-b619-feeba33c8982. {{(pid=87119) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 18:53:53 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Creating volume glance metadata for volume 52481c63-555a-4f21-b619-feeba33c8982 backed by image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87119) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 18:53:54 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13cc562c-2a55-4b36-ae54-b903d658b98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52481c63-555a-4f21-b619-feeba33c8982', 'volume_size': 1, 'image_id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '184bff60e125442790f1bc12f0dfbe3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'created_at': datetime.datetime(2026, 11, 4, 17, 42, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:54 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e82958c7-bce5-4056-861e-bb34a688223c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:54 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Volume volume-52481c63-555a-4f21-b619-feeba33c8982 (52481c63-555a-4f21-b619-feeba33c8982): created successfully Nov 04 18:53:54 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e82958c7-bce5-4056-861e-bb34a688223c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:54 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Flow 'volume_create_manager' (14c3f2d4-8958-4201-8f79-1f9b249d5b37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:53:54 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-9f2c5c0d-76fb-4918-9311-a1debff672b9 tempest-VolumesExtendTest-922917118 None] Created volume successfully. Nov 04 18:53:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a95724ca-de12-4e2a-a13b-4e5cac248acd tempest-VolumesExtendTest-922917118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a95724ca-de12-4e2a-a13b-4e5cac248acd tempest-VolumesExtendTest-922917118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:55 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[8002185b-817d-44ac-918f-d685f2c7064b]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a95724ca-de12-4e2a-a13b-4e5cac248acd tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-52481c63-555a-4f21-b619-feeba33c8982 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:55 devstack sudo[95052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-52481c63-555a-4f21-b619-feeba33c8982 Nov 04 18:53:55 devstack sudo[95052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:55 devstack sudo[95052]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a95724ca-de12-4e2a-a13b-4e5cac248acd tempest-VolumesExtendTest-922917118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-52481c63-555a-4f21-b619-feeba33c8982" returned: 0 in 0.480s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a95724ca-de12-4e2a-a13b-4e5cac248acd tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-52481c63-555a-4f21-b619-feeba33c8982 2G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a95724ca-de12-4e2a-a13b-4e5cac248acd tempest-VolumesExtendTest-922917118 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-52481c63-555a-4f21-b619-feeba33c8982 2G" returned: 0 in 0.151s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a95724ca-de12-4e2a-a13b-4e5cac248acd tempest-VolumesExtendTest-922917118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.681s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:55 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-a95724ca-de12-4e2a-a13b-4e5cac248acd tempest-VolumesExtendTest-922917118 None] Extend volume completed successfully. Nov 04 18:53:57 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e668306c-3edd-4de7-b434-38954429e56a tempest-VolumesExtendTest-922917118 None] Acquiring lock "cinder-52481c63-555a-4f21-b619-feeba33c8982-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:57 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e668306c-3edd-4de7-b434-38954429e56a tempest-VolumesExtendTest-922917118 None] Lock "cinder-52481c63-555a-4f21-b619-feeba33c8982-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:57 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e668306c-3edd-4de7-b434-38954429e56a tempest-VolumesExtendTest-922917118 None] Acquiring lock "cinder-quobyte-52481c63-555a-4f21-b619-feeba33c8982" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:57 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e668306c-3edd-4de7-b434-38954429e56a tempest-VolumesExtendTest-922917118 None] Lock "cinder-quobyte-52481c63-555a-4f21-b619-feeba33c8982" acquired by "delete_volume" :: waited 0.029s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:57 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec52a4f-dbf1-4bc0-bfcb-1270bd79b965]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e668306c-3edd-4de7-b434-38954429e56a tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-52481c63-555a-4f21-b619-feeba33c8982 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:57 devstack sudo[95062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-52481c63-555a-4f21-b619-feeba33c8982 Nov 04 18:53:57 devstack sudo[95062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:57 devstack sudo[95062]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e668306c-3edd-4de7-b434-38954429e56a tempest-VolumesExtendTest-922917118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-52481c63-555a-4f21-b619-feeba33c8982" returned: 0 in 0.477s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e668306c-3edd-4de7-b434-38954429e56a tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-52481c63-555a-4f21-b619-feeba33c8982 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:57 devstack sudo[95068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-52481c63-555a-4f21-b619-feeba33c8982 Nov 04 18:53:57 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:57 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e668306c-3edd-4de7-b434-38954429e56a tempest-VolumesExtendTest-922917118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-52481c63-555a-4f21-b619-feeba33c8982" returned: 0 in 0.303s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e668306c-3edd-4de7-b434-38954429e56a tempest-VolumesExtendTest-922917118 None] Lock "cinder-quobyte-52481c63-555a-4f21-b619-feeba33c8982" released by "delete_volume" :: held 0.838s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-e668306c-3edd-4de7-b434-38954429e56a tempest-VolumesExtendTest-922917118 None] Created reservations ['b596754d-f77b-46b3-8ca8-71084dc6c91c', '5570e89a-06e0-4f87-ba50-8a07256986cd', 'edde021f-3b72-49fe-866d-be30f0e58d76', 'f8e457f4-e6f6-468f-a735-6f0f0e6a4ac0'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e668306c-3edd-4de7-b434-38954429e56a tempest-VolumesExtendTest-922917118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e668306c-3edd-4de7-b434-38954429e56a tempest-VolumesExtendTest-922917118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e668306c-3edd-4de7-b434-38954429e56a tempest-VolumesExtendTest-922917118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e668306c-3edd-4de7-b434-38954429e56a tempest-VolumesExtendTest-922917118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e668306c-3edd-4de7-b434-38954429e56a tempest-VolumesExtendTest-922917118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e668306c-3edd-4de7-b434-38954429e56a tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:58 devstack sudo[95071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:53:58 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Flow 'volume_create_manager' (6d6b6d9c-619d-4688-bd3c-d83995d53862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a896d689-88de-45a5-87d3-c8852a963c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a896d689-88de-45a5-87d3-c8852a963c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-230942675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf624a7a-e6f4-46c6-8db3-673b780189f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ac2c367c9941e68a2468801384e4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:53:58Z,use_quota=True,user_id='3bbf7067e0a64df29bfaff27346a7100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75123d9b-836c-4fe9-89c6-4a1ed5483c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75123d9b-836c-4fe9-89c6-4a1ed5483c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48fb40d5-5986-43eb-90fa-ec332dbd7cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48fb40d5-5986-43eb-90fa-ec332dbd7cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf624a7a-e6f4-46c6-8db3-673b780189f2', 'volume_name': 'volume-bf624a7a-e6f4-46c6-8db3-673b780189f2', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7e54a0a-70e4-46e6-82dd-c59235350396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7e54a0a-70e4-46e6-82dd-c59235350396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a50b6b8d-47ac-4fd8-abe3-675e8d3125f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:58 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Volume bf624a7a-e6f4-46c6-8db3-673b780189f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf624a7a-e6f4-46c6-8db3-673b780189f2', 'volume_size': 1} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-230942675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf624a7a-e6f4-46c6-8db3-673b780189f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ac2c367c9941e68a2468801384e4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:53:58Z,use_quota=True,user_id='3bbf7067e0a64df29bfaff27346a7100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Creating volume bf624a7a-e6f4-46c6-8db3-673b780189f2 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:53:58 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bf624a7a-e6f4-46c6-8db3-673b780189f2 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:58 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bf624a7a-e6f4-46c6-8db3-673b780189f2 1073741824 Nov 04 18:53:58 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:58 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e668306c-3edd-4de7-b434-38954429e56a tempest-VolumesExtendTest-922917118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.495s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-e668306c-3edd-4de7-b434-38954429e56a tempest-VolumesExtendTest-922917118 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:53:58 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e668306c-3edd-4de7-b434-38954429e56a tempest-VolumesExtendTest-922917118 None] Deleted volume successfully. Nov 04 18:53:58 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e668306c-3edd-4de7-b434-38954429e56a tempest-VolumesExtendTest-922917118 None] Lock "cinder-52481c63-555a-4f21-b619-feeba33c8982-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Flow 'volume_create_manager' (8ce36840-c668-4ecb-8fa8-aa8cfb5d549f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29b2b9b-373a-4753-8504-870a9420e7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29b2b9b-373a-4753-8504-870a9420e7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-350928234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d64da54d-5a86-4cb8-8e54-1087756e953c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092fb425dea64db59cc35c6202c0ca84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:53:59Z,use_quota=True,user_id='10a1451ed9394206a1719a09cb9ca0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e38ff5-27ce-4f07-a340-23328f4f74a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e38ff5-27ce-4f07-a340-23328f4f74a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f654461f-362c-4e84-b106-82b82a169c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f654461f-362c-4e84-b106-82b82a169c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd64da54d-5a86-4cb8-8e54-1087756e953c', 'volume_name': 'volume-d64da54d-5a86-4cb8-8e54-1087756e953c', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60991b45-22bc-40eb-91b1-078cea7b4dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60991b45-22bc-40eb-91b1-078cea7b4dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a633b506-83d4-41e9-a5bc-cd01e39f27a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:59 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Volume d64da54d-5a86-4cb8-8e54-1087756e953c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d64da54d-5a86-4cb8-8e54-1087756e953c', 'volume_size': 1} Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:59 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bf624a7a-e6f4-46c6-8db3-673b780189f2 1073741824" returned: 0 in 0.616s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bf624a7a-e6f4-46c6-8db3-673b780189f2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:59 devstack sudo[95080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bf624a7a-e6f4-46c6-8db3-673b780189f2 Nov 04 18:53:59 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:59 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bf624a7a-e6f4-46c6-8db3-673b780189f2" returned: 0 in 0.269s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.385s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-350928234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d64da54d-5a86-4cb8-8e54-1087756e953c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092fb425dea64db59cc35c6202c0ca84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:53:59Z,use_quota=True,user_id='10a1451ed9394206a1719a09cb9ca0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Creating volume d64da54d-5a86-4cb8-8e54-1087756e953c {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:53:59 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a50b6b8d-47ac-4fd8-abe3-675e8d3125f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf624a7a-e6f4-46c6-8db3-673b780189f2', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:59 devstack sudo[95083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c 1073741824 Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd5c242c-387e-4fa1-9128-19c59885c16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:59 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:59 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Volume volume-bf624a7a-e6f4-46c6-8db3-673b780189f2 (bf624a7a-e6f4-46c6-8db3-673b780189f2): created successfully Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd5c242c-387e-4fa1-9128-19c59885c16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Flow 'volume_create_manager' (6d6b6d9c-619d-4688-bd3c-d83995d53862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:53:59 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-56b3ceaa-9a87-464d-a76a-2cac27d33f2a tempest-VolumesTransfersV355Test-289023889 None] Created volume successfully. Nov 04 18:54:00 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c 1073741824" returned: 0 in 0.519s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:00 devstack sudo[95089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c Nov 04 18:54:00 devstack sudo[95089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:00 devstack sudo[95089]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c" returned: 0 in 0.250s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:00 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:54:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:00 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a633b506-83d4-41e9-a5bc-cd01e39f27a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d64da54d-5a86-4cb8-8e54-1087756e953c', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:00 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43890ea2-0ef9-46bc-970f-f7a921101ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:00 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Volume volume-d64da54d-5a86-4cb8-8e54-1087756e953c (d64da54d-5a86-4cb8-8e54-1087756e953c): created successfully Nov 04 18:54:00 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43890ea2-0ef9-46bc-970f-f7a921101ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:00 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Flow 'volume_create_manager' (8ce36840-c668-4ecb-8fa8-aa8cfb5d549f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:54:00 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-402d8f3d-5bb0-463a-b1c3-da2200ca7572 tempest-VolumesExtendTest-922917118 None] Created volume successfully. Nov 04 18:54:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ecc082de-1f85-411c-9188-12522e69922b tempest-VolumesExtendTest-922917118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ecc082de-1f85-411c-9188-12522e69922b tempest-VolumesExtendTest-922917118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:01 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-ecc082de-1f85-411c-9188-12522e69922b tempest-VolumesExtendTest-922917118 None] Creating offline snapshot 76fe22b3-b10c-4b0c-8445-a0417918e771 of volume d64da54d-5a86-4cb8-8e54-1087756e953c {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:54:01 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde579a3-5df2-4d6d-b66b-16ecd3e477e8]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:54:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ecc082de-1f85-411c-9188-12522e69922b tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:01 devstack sudo[95092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c Nov 04 18:54:01 devstack sudo[95092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:01 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-4428a94a-1eb6-4d4d-8a6e-753d6074fd3b tempest-VolumesTransfersV355Test-1394379951 None] Transfer volume completed successfully. Nov 04 18:54:02 devstack sudo[95092]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ecc082de-1f85-411c-9188-12522e69922b tempest-VolumesExtendTest-922917118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c" returned: 0 in 0.686s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ecc082de-1f85-411c-9188-12522e69922b tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c.76fe22b3-b10c-4b0c-8445-a0417918e771 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:02 devstack sudo[95097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c.76fe22b3-b10c-4b0c-8445-a0417918e771 1G Nov 04 18:54:02 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:02 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-20623d6d-1f49-47e3-98b5-a1cc5cb40d6e tempest-VolumesTransfersV355Test-111039877 None] Acquiring lock "cinder-bf624a7a-e6f4-46c6-8db3-673b780189f2-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:02 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-20623d6d-1f49-47e3-98b5-a1cc5cb40d6e tempest-VolumesTransfersV355Test-111039877 None] Lock "cinder-bf624a7a-e6f4-46c6-8db3-673b780189f2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:02 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-20623d6d-1f49-47e3-98b5-a1cc5cb40d6e tempest-VolumesTransfersV355Test-111039877 None] Acquiring lock "cinder-quobyte-bf624a7a-e6f4-46c6-8db3-673b780189f2" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:02 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-20623d6d-1f49-47e3-98b5-a1cc5cb40d6e tempest-VolumesTransfersV355Test-111039877 None] Lock "cinder-quobyte-bf624a7a-e6f4-46c6-8db3-673b780189f2" acquired by "delete_volume" :: waited 0.024s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:02 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cdc3a4-5405-41af-9cd7-3420038784e2]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:54:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-20623d6d-1f49-47e3-98b5-a1cc5cb40d6e tempest-VolumesTransfersV355Test-111039877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bf624a7a-e6f4-46c6-8db3-673b780189f2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:03 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:03 devstack sudo[95105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bf624a7a-e6f4-46c6-8db3-673b780189f2 Nov 04 18:54:03 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ecc082de-1f85-411c-9188-12522e69922b tempest-VolumesExtendTest-922917118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c.76fe22b3-b10c-4b0c-8445-a0417918e771 1G" returned: 0 in 0.915s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ecc082de-1f85-411c-9188-12522e69922b tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d64da54d-5a86-4cb8-8e54-1087756e953c -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c.76fe22b3-b10c-4b0c-8445-a0417918e771 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:03 devstack sudo[95107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d64da54d-5a86-4cb8-8e54-1087756e953c -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c.76fe22b3-b10c-4b0c-8445-a0417918e771 Nov 04 18:54:03 devstack sudo[95107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:03 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-20623d6d-1f49-47e3-98b5-a1cc5cb40d6e tempest-VolumesTransfersV355Test-111039877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bf624a7a-e6f4-46c6-8db3-673b780189f2" returned: 0 in 0.496s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-20623d6d-1f49-47e3-98b5-a1cc5cb40d6e tempest-VolumesTransfersV355Test-111039877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bf624a7a-e6f4-46c6-8db3-673b780189f2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:03 devstack sudo[95114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bf624a7a-e6f4-46c6-8db3-673b780189f2 Nov 04 18:54:03 devstack sudo[95114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:03 devstack sudo[95107]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ecc082de-1f85-411c-9188-12522e69922b tempest-VolumesExtendTest-922917118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d64da54d-5a86-4cb8-8e54-1087756e953c -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c.76fe22b3-b10c-4b0c-8445-a0417918e771" returned: 0 in 0.477s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:03 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-ecc082de-1f85-411c-9188-12522e69922b tempest-VolumesExtendTest-922917118 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c.76fe22b3-b10c-4b0c-8445-a0417918e771 is being set with open permissions: ugo+rw Nov 04 18:54:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ecc082de-1f85-411c-9188-12522e69922b tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c.76fe22b3-b10c-4b0c-8445-a0417918e771 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:03 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c.76fe22b3-b10c-4b0c-8445-a0417918e771 Nov 04 18:54:03 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:03 devstack sudo[95114]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-20623d6d-1f49-47e3-98b5-a1cc5cb40d6e tempest-VolumesTransfersV355Test-111039877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bf624a7a-e6f4-46c6-8db3-673b780189f2" returned: 0 in 0.347s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:03 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-20623d6d-1f49-47e3-98b5-a1cc5cb40d6e tempest-VolumesTransfersV355Test-111039877 None] Lock "cinder-quobyte-bf624a7a-e6f4-46c6-8db3-673b780189f2" released by "delete_volume" :: held 0.910s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:54:03 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-20623d6d-1f49-47e3-98b5-a1cc5cb40d6e tempest-VolumesTransfersV355Test-111039877 None] Created reservations ['1c299565-70cf-42bd-bb38-ca5fab08bf89', '25841c43-a3d4-488d-9f3d-cc68a50a9060', '44feb0af-28b9-4e74-a868-d32698ab9a24', '8508b597-56b7-443b-9aad-bcc8747c698a'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:54:04 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ecc082de-1f85-411c-9188-12522e69922b tempest-VolumesExtendTest-922917118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c.76fe22b3-b10c-4b0c-8445-a0417918e771" returned: 0 in 0.414s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-20623d6d-1f49-47e3-98b5-a1cc5cb40d6e tempest-VolumesTransfersV355Test-111039877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-20623d6d-1f49-47e3-98b5-a1cc5cb40d6e tempest-VolumesTransfersV355Test-111039877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:04 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-20623d6d-1f49-47e3-98b5-a1cc5cb40d6e tempest-VolumesTransfersV355Test-111039877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:54:04 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-20623d6d-1f49-47e3-98b5-a1cc5cb40d6e tempest-VolumesTransfersV355Test-111039877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:54:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-20623d6d-1f49-47e3-98b5-a1cc5cb40d6e tempest-VolumesTransfersV355Test-111039877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-20623d6d-1f49-47e3-98b5-a1cc5cb40d6e tempest-VolumesTransfersV355Test-111039877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ecc082de-1f85-411c-9188-12522e69922b tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:04 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:54:04 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:04 devstack sudo[95123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c.info Nov 04 18:54:04 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:04 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:04 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ecc082de-1f85-411c-9188-12522e69922b tempest-VolumesExtendTest-922917118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c.info" returned: 0 in 0.384s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:04 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-ecc082de-1f85-411c-9188-12522e69922b tempest-VolumesExtendTest-922917118 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c.info is being set with open permissions: ugo+rw Nov 04 18:54:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ecc082de-1f85-411c-9188-12522e69922b tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-20623d6d-1f49-47e3-98b5-a1cc5cb40d6e tempest-VolumesTransfersV355Test-111039877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.466s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:04 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-20623d6d-1f49-47e3-98b5-a1cc5cb40d6e tempest-VolumesTransfersV355Test-111039877 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:54:04 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-20623d6d-1f49-47e3-98b5-a1cc5cb40d6e tempest-VolumesTransfersV355Test-111039877 None] Deleted volume successfully. Nov 04 18:54:04 devstack sudo[95127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c.info Nov 04 18:54:04 devstack sudo[95127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-20623d6d-1f49-47e3-98b5-a1cc5cb40d6e tempest-VolumesTransfersV355Test-111039877 None] Lock "cinder-bf624a7a-e6f4-46c6-8db3-673b780189f2-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:54:04 devstack sudo[95127]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ecc082de-1f85-411c-9188-12522e69922b tempest-VolumesExtendTest-922917118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c.info" returned: 0 in 0.395s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ecc082de-1f85-411c-9188-12522e69922b tempest-VolumesExtendTest-922917118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.544s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:05 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-ecc082de-1f85-411c-9188-12522e69922b tempest-VolumesExtendTest-922917118 None] Create snapshot completed successfully Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Flow 'volume_create_manager' (0148e8fa-7535-4c51-b1c6-39352a267219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95281f5-718f-44ba-871a-8a7f4910dc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95281f5-718f-44ba-871a-8a7f4910dc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1725521853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b65b2a0-2edd-4918-a14e-87e41a2daf8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ac2c367c9941e68a2468801384e4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:54:05Z,use_quota=True,user_id='3bbf7067e0a64df29bfaff27346a7100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e4ef7c-8fe6-47b6-99e0-a522fa51a71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e4ef7c-8fe6-47b6-99e0-a522fa51a71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3686e1cc-c779-448e-ac50-f609401b10a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3686e1cc-c779-448e-ac50-f609401b10a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b65b2a0-2edd-4918-a14e-87e41a2daf8e', 'volume_name': 'volume-6b65b2a0-2edd-4918-a14e-87e41a2daf8e', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b86d08b5-2b4a-41a0-b61e-0154828fe731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b86d08b5-2b4a-41a0-b61e-0154828fe731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b89d9898-f176-4024-afa4-08849ec75c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:05 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Volume 6b65b2a0-2edd-4918-a14e-87e41a2daf8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b65b2a0-2edd-4918-a14e-87e41a2daf8e', 'volume_size': 1} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1725521853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b65b2a0-2edd-4918-a14e-87e41a2daf8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ac2c367c9941e68a2468801384e4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:54:05Z,use_quota=True,user_id='3bbf7067e0a64df29bfaff27346a7100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Creating volume 6b65b2a0-2edd-4918-a14e-87e41a2daf8e {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:54:05 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b65b2a0-2edd-4918-a14e-87e41a2daf8e 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:05 devstack sudo[95131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b65b2a0-2edd-4918-a14e-87e41a2daf8e 1073741824 Nov 04 18:54:05 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:05 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b65b2a0-2edd-4918-a14e-87e41a2daf8e 1073741824" returned: 0 in 0.464s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b65b2a0-2edd-4918-a14e-87e41a2daf8e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:05 devstack sudo[95137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b65b2a0-2edd-4918-a14e-87e41a2daf8e Nov 04 18:54:05 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e619fda3-770e-4da1-bc29-4bf23192dca9 tempest-VolumesExtendTest-922917118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:05 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b65b2a0-2edd-4918-a14e-87e41a2daf8e" returned: 0 in 0.298s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e619fda3-770e-4da1-bc29-4bf23192dca9 tempest-VolumesExtendTest-922917118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.084s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b89d9898-f176-4024-afa4-08849ec75c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b65b2a0-2edd-4918-a14e-87e41a2daf8e', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f3461a-b9d7-4c5c-9794-8f9b241089fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bd15ea-641f-4156-8c7b-0b564632bfcd]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:54:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e619fda3-770e-4da1-bc29-4bf23192dca9 tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:06 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Volume volume-6b65b2a0-2edd-4918-a14e-87e41a2daf8e (6b65b2a0-2edd-4918-a14e-87e41a2daf8e): created successfully Nov 04 18:54:06 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f3461a-b9d7-4c5c-9794-8f9b241089fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:06 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Flow 'volume_create_manager' (0148e8fa-7535-4c51-b1c6-39352a267219) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:54:06 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-4bb8fd24-5010-4853-8301-4d40f2f03d56 tempest-VolumesTransfersV355Test-289023889 None] Created volume successfully. Nov 04 18:54:06 devstack sudo[95140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c Nov 04 18:54:06 devstack sudo[95140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:06 devstack sudo[95140]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e619fda3-770e-4da1-bc29-4bf23192dca9 tempest-VolumesExtendTest-922917118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c" returned: 0 in 0.408s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e619fda3-770e-4da1-bc29-4bf23192dca9 tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c.76fe22b3-b10c-4b0c-8445-a0417918e771 2G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e619fda3-770e-4da1-bc29-4bf23192dca9 tempest-VolumesExtendTest-922917118 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c.76fe22b3-b10c-4b0c-8445-a0417918e771 2G" returned: 0 in 0.143s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e619fda3-770e-4da1-bc29-4bf23192dca9 tempest-VolumesExtendTest-922917118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.604s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:06 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e619fda3-770e-4da1-bc29-4bf23192dca9 tempest-VolumesExtendTest-922917118 None] Extend volume completed successfully. Nov 04 18:54:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-785dbd69-ecab-484a-831a-3033dbdd2d0e tempest-VolumesExtendTest-922917118 None] Acquiring lock "cinder-76fe22b3-b10c-4b0c-8445-a0417918e771-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-785dbd69-ecab-484a-831a-3033dbdd2d0e tempest-VolumesExtendTest-922917118 None] Lock "cinder-76fe22b3-b10c-4b0c-8445-a0417918e771-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-785dbd69-ecab-484a-831a-3033dbdd2d0e tempest-VolumesExtendTest-922917118 None] Acquiring lock "cinder-quobyte-d64da54d-5a86-4cb8-8e54-1087756e953c" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-785dbd69-ecab-484a-831a-3033dbdd2d0e tempest-VolumesExtendTest-922917118 None] Lock "cinder-quobyte-d64da54d-5a86-4cb8-8e54-1087756e953c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-785dbd69-ecab-484a-831a-3033dbdd2d0e tempest-VolumesExtendTest-922917118 None] Acquiring lock "cinder-quobyte-76fe22b3-b10c-4b0c-8445-a0417918e771" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-785dbd69-ecab-484a-831a-3033dbdd2d0e tempest-VolumesExtendTest-922917118 None] Lock "cinder-quobyte-76fe22b3-b10c-4b0c-8445-a0417918e771" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-785dbd69-ecab-484a-831a-3033dbdd2d0e tempest-VolumesExtendTest-922917118 None] Deleting offline snapshot 76fe22b3-b10c-4b0c-8445-a0417918e771 of volume d64da54d-5a86-4cb8-8e54-1087756e953c {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:54:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-785dbd69-ecab-484a-831a-3033dbdd2d0e tempest-VolumesExtendTest-922917118 None] snapshot_file for this snap is: volume-d64da54d-5a86-4cb8-8e54-1087756e953c.76fe22b3-b10c-4b0c-8445-a0417918e771 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:54:07 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b959864-51dd-49f8-b5bd-472d93a3f21a]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:54:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-785dbd69-ecab-484a-831a-3033dbdd2d0e tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c.76fe22b3-b10c-4b0c-8445-a0417918e771 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:07 devstack sudo[95150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c.76fe22b3-b10c-4b0c-8445-a0417918e771 Nov 04 18:54:07 devstack sudo[95150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a3f4bd45-a576-444b-b376-2e8ccab666ec tempest-VolumesTransfersV355Test-111039877 None] Acquiring lock "cinder-6b65b2a0-2edd-4918-a14e-87e41a2daf8e-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a3f4bd45-a576-444b-b376-2e8ccab666ec tempest-VolumesTransfersV355Test-111039877 None] Lock "cinder-6b65b2a0-2edd-4918-a14e-87e41a2daf8e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a3f4bd45-a576-444b-b376-2e8ccab666ec tempest-VolumesTransfersV355Test-111039877 None] Acquiring lock "cinder-quobyte-6b65b2a0-2edd-4918-a14e-87e41a2daf8e" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a3f4bd45-a576-444b-b376-2e8ccab666ec tempest-VolumesTransfersV355Test-111039877 None] Lock "cinder-quobyte-6b65b2a0-2edd-4918-a14e-87e41a2daf8e" acquired by "delete_volume" :: waited 0.020s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:07 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[934d617b-0c19-4e3f-bad0-a29fa671bd1a]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:54:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a3f4bd45-a576-444b-b376-2e8ccab666ec tempest-VolumesTransfersV355Test-111039877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b65b2a0-2edd-4918-a14e-87e41a2daf8e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:07 devstack sudo[95150]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-785dbd69-ecab-484a-831a-3033dbdd2d0e tempest-VolumesExtendTest-922917118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c.76fe22b3-b10c-4b0c-8445-a0417918e771" returned: 0 in 0.465s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-785dbd69-ecab-484a-831a-3033dbdd2d0e tempest-VolumesExtendTest-922917118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d64da54d-5a86-4cb8-8e54-1087756e953c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:54:07 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e14f89-4aae-4561-b0b9-ffb144ab93a1]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:54:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-785dbd69-ecab-484a-831a-3033dbdd2d0e tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:07 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b65b2a0-2edd-4918-a14e-87e41a2daf8e Nov 04 18:54:07 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:07 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c Nov 04 18:54:07 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:08 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a3f4bd45-a576-444b-b376-2e8ccab666ec tempest-VolumesTransfersV355Test-111039877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b65b2a0-2edd-4918-a14e-87e41a2daf8e" returned: 0 in 0.396s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a3f4bd45-a576-444b-b376-2e8ccab666ec tempest-VolumesTransfersV355Test-111039877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b65b2a0-2edd-4918-a14e-87e41a2daf8e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:08 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b65b2a0-2edd-4918-a14e-87e41a2daf8e Nov 04 18:54:08 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:08 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-785dbd69-ecab-484a-831a-3033dbdd2d0e tempest-VolumesExtendTest-922917118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c" returned: 0 in 0.418s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-785dbd69-ecab-484a-831a-3033dbdd2d0e tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c.76fe22b3-b10c-4b0c-8445-a0417918e771 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:08 devstack sudo[95167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c.76fe22b3-b10c-4b0c-8445-a0417918e771 Nov 04 18:54:08 devstack sudo[95167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:08 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a3f4bd45-a576-444b-b376-2e8ccab666ec tempest-VolumesTransfersV355Test-111039877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b65b2a0-2edd-4918-a14e-87e41a2daf8e" returned: 0 in 0.306s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a3f4bd45-a576-444b-b376-2e8ccab666ec tempest-VolumesTransfersV355Test-111039877 None] Lock "cinder-quobyte-6b65b2a0-2edd-4918-a14e-87e41a2daf8e" released by "delete_volume" :: held 0.759s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-a3f4bd45-a576-444b-b376-2e8ccab666ec tempest-VolumesTransfersV355Test-111039877 None] Created reservations ['0b8f60ef-3152-4227-965d-019c7e56b649', '1dee6414-7a38-42aa-a82f-7b0951c06615', '7656a2f2-9d9b-4da7-8294-13cefb4d8bf2', '59eac78f-a565-492d-8ed1-c2c88f1f15ea'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Flow 'volume_create_manager' (6fb6b1a8-986a-4e54-b2df-76cf22a861d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d7bb4d-1ec3-4712-b944-1f904f84fd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a3f4bd45-a576-444b-b376-2e8ccab666ec tempest-VolumesTransfersV355Test-111039877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a3f4bd45-a576-444b-b376-2e8ccab666ec tempest-VolumesTransfersV355Test-111039877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a3f4bd45-a576-444b-b376-2e8ccab666ec tempest-VolumesTransfersV355Test-111039877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a3f4bd45-a576-444b-b376-2e8ccab666ec tempest-VolumesTransfersV355Test-111039877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a3f4bd45-a576-444b-b376-2e8ccab666ec tempest-VolumesTransfersV355Test-111039877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a3f4bd45-a576-444b-b376-2e8ccab666ec tempest-VolumesTransfersV355Test-111039877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:08 devstack sudo[95174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:54:08 devstack sudo[95174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d7bb4d-1ec3-4712-b944-1f904f84fd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2091143424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bccea3ee0b694176931e95117f54edb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:54:08Z,use_quota=True,user_id='34f9001c4e734d1fb12c558dcfc2b2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61aaf311-d895-48a4-97be-e29b5bc42983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61aaf311-d895-48a4-97be-e29b5bc42983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5b89b2-44f1-48ec-bf38-dac7497f9e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5b89b2-44f1-48ec-bf38-dac7497f9e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e', 'volume_name': 'volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:08 devstack sudo[95167]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d132e060-e1a6-4e49-a161-61d8792de531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d132e060-e1a6-4e49-a161-61d8792de531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ebe431e-e8f6-440c-b13c-1396339c154d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:08 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Volume 07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e', 'volume_size': 1} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2091143424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bccea3ee0b694176931e95117f54edb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:54:08Z,use_quota=True,user_id='34f9001c4e734d1fb12c558dcfc2b2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Creating volume 07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:54:08 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-785dbd69-ecab-484a-831a-3033dbdd2d0e tempest-VolumesExtendTest-922917118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c.76fe22b3-b10c-4b0c-8445-a0417918e771" returned: 0 in 0.513s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-785dbd69-ecab-484a-831a-3033dbdd2d0e tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c.76fe22b3-b10c-4b0c-8445-a0417918e771 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:08 devstack sudo[95176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e 1073741824 Nov 04 18:54:08 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:08 devstack sudo[95177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c.76fe22b3-b10c-4b0c-8445-a0417918e771 Nov 04 18:54:08 devstack sudo[95177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:08 devstack sudo[95174]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a3f4bd45-a576-444b-b376-2e8ccab666ec tempest-VolumesTransfersV355Test-111039877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.273s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-a3f4bd45-a576-444b-b376-2e8ccab666ec tempest-VolumesTransfersV355Test-111039877 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:54:08 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-a3f4bd45-a576-444b-b376-2e8ccab666ec tempest-VolumesTransfersV355Test-111039877 None] Deleted volume successfully. Nov 04 18:54:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a3f4bd45-a576-444b-b376-2e8ccab666ec tempest-VolumesTransfersV355Test-111039877 None] Lock "cinder-6b65b2a0-2edd-4918-a14e-87e41a2daf8e-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:54:09 devstack sudo[95177]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-785dbd69-ecab-484a-831a-3033dbdd2d0e tempest-VolumesExtendTest-922917118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c.76fe22b3-b10c-4b0c-8445-a0417918e771" returned: 0 in 0.313s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-785dbd69-ecab-484a-831a-3033dbdd2d0e tempest-VolumesExtendTest-922917118 None] Lock "cinder-quobyte-76fe22b3-b10c-4b0c-8445-a0417918e771" released by "_delete_snapshot" :: held 1.842s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:54:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-785dbd69-ecab-484a-831a-3033dbdd2d0e tempest-VolumesExtendTest-922917118 None] Lock "cinder-quobyte-d64da54d-5a86-4cb8-8e54-1087756e953c" released by "delete_snapshot" :: held 1.879s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:54:09 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-785dbd69-ecab-484a-831a-3033dbdd2d0e tempest-VolumesExtendTest-922917118 None] Created reservations ['659b7bfc-a76a-4d37-8be8-9b7b3313fd99', '0d73b3d5-ece1-42aa-b011-ccd977f573e4', '551047b4-8c14-49ae-ac9b-dc13ac29cc11', '4fb2786d-c9f1-4aff-9166-690f94bf48e5'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:54:09 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-785dbd69-ecab-484a-831a-3033dbdd2d0e tempest-VolumesExtendTest-922917118 None] Delete snapshot completed successfully. Nov 04 18:54:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-785dbd69-ecab-484a-831a-3033dbdd2d0e tempest-VolumesExtendTest-922917118 None] Lock "cinder-76fe22b3-b10c-4b0c-8445-a0417918e771-delete_snapshot" released by "delete_snapshot" :: held 2.076s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:54:09 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e 1073741824" returned: 0 in 0.572s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:09 devstack sudo[95185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e Nov 04 18:54:09 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-dabf0a98-bc1f-4868-bb71-08049ea91fd3 tempest-VolumesExtendTest-922917118 None] Acquiring lock "cinder-d64da54d-5a86-4cb8-8e54-1087756e953c-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-dabf0a98-bc1f-4868-bb71-08049ea91fd3 tempest-VolumesExtendTest-922917118 None] Lock "cinder-d64da54d-5a86-4cb8-8e54-1087756e953c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:09 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-dabf0a98-bc1f-4868-bb71-08049ea91fd3 tempest-VolumesExtendTest-922917118 None] Acquiring lock "cinder-quobyte-d64da54d-5a86-4cb8-8e54-1087756e953c" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e" returned: 0 in 0.308s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:54:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ebe431e-e8f6-440c-b13c-1396339c154d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4b3106-e049-4bf3-8589-68083b2a7bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-dabf0a98-bc1f-4868-bb71-08049ea91fd3 tempest-VolumesExtendTest-922917118 None] Lock "cinder-quobyte-d64da54d-5a86-4cb8-8e54-1087756e953c" acquired by "delete_volume" :: waited 0.047s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:09 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Volume volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e (07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e): created successfully Nov 04 18:54:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4b3106-e049-4bf3-8589-68083b2a7bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Flow 'volume_create_manager' (6fb6b1a8-986a-4e54-b2df-76cf22a861d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:54:09 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[38aebd35-ce4f-43a7-8575-9d151fe1cfcd]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:54:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-dabf0a98-bc1f-4868-bb71-08049ea91fd3 tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:09 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-422284ad-b958-4b0b-8a40-d63599a6ac36 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Created volume successfully. Nov 04 18:54:09 devstack sudo[95189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c Nov 04 18:54:09 devstack sudo[95189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:10 devstack sudo[95189]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-dabf0a98-bc1f-4868-bb71-08049ea91fd3 tempest-VolumesExtendTest-922917118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c" returned: 0 in 0.463s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-dabf0a98-bc1f-4868-bb71-08049ea91fd3 tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:10 devstack sudo[95201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c Nov 04 18:54:10 devstack sudo[95201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:10 devstack sudo[95201]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-dabf0a98-bc1f-4868-bb71-08049ea91fd3 tempest-VolumesExtendTest-922917118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d64da54d-5a86-4cb8-8e54-1087756e953c" returned: 0 in 0.299s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-dabf0a98-bc1f-4868-bb71-08049ea91fd3 tempest-VolumesExtendTest-922917118 None] Lock "cinder-quobyte-d64da54d-5a86-4cb8-8e54-1087756e953c" released by "delete_volume" :: held 0.867s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:54:10 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-dabf0a98-bc1f-4868-bb71-08049ea91fd3 tempest-VolumesExtendTest-922917118 None] Created reservations ['622071f3-4b41-4f82-b376-46a9578ba96f', '2914cecc-b226-4e79-ba9b-2304665fe996', '9a1ee387-c652-46bd-8ae4-0a6354bb535d', 'f42b68d1-fb2f-4529-8239-f2f01b25b62b'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:54:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-dabf0a98-bc1f-4868-bb71-08049ea91fd3 tempest-VolumesExtendTest-922917118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-dabf0a98-bc1f-4868-bb71-08049ea91fd3 tempest-VolumesExtendTest-922917118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-dabf0a98-bc1f-4868-bb71-08049ea91fd3 tempest-VolumesExtendTest-922917118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:54:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-dabf0a98-bc1f-4868-bb71-08049ea91fd3 tempest-VolumesExtendTest-922917118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:54:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-dabf0a98-bc1f-4868-bb71-08049ea91fd3 tempest-VolumesExtendTest-922917118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-dabf0a98-bc1f-4868-bb71-08049ea91fd3 tempest-VolumesExtendTest-922917118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:10 devstack sudo[95205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:54:10 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-09d243d3-2c75-4767-8a46-6122d01be031 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-09d243d3-2c75-4767-8a46-6122d01be031 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:11 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-09d243d3-2c75-4767-8a46-6122d01be031 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Creating offline snapshot 310a7fe5-e78c-4379-9178-e03bd4fae02b of volume 07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:54:11 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8af0a9b-b5aa-489b-9af8-f4afe4aa28ca]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:54:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-09d243d3-2c75-4767-8a46-6122d01be031 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:11 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-dabf0a98-bc1f-4868-bb71-08049ea91fd3 tempest-VolumesExtendTest-922917118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.368s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:11 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-dabf0a98-bc1f-4868-bb71-08049ea91fd3 tempest-VolumesExtendTest-922917118 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:54:11 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-dabf0a98-bc1f-4868-bb71-08049ea91fd3 tempest-VolumesExtendTest-922917118 None] Deleted volume successfully. Nov 04 18:54:11 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-dabf0a98-bc1f-4868-bb71-08049ea91fd3 tempest-VolumesExtendTest-922917118 None] Lock "cinder-d64da54d-5a86-4cb8-8e54-1087756e953c-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:54:11 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e Nov 04 18:54:11 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:11 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-09d243d3-2c75-4767-8a46-6122d01be031 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e" returned: 0 in 0.551s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-09d243d3-2c75-4767-8a46-6122d01be031 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e.310a7fe5-e78c-4379-9178-e03bd4fae02b 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:11 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e.310a7fe5-e78c-4379-9178-e03bd4fae02b 1G Nov 04 18:54:11 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:12 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-09d243d3-2c75-4767-8a46-6122d01be031 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e.310a7fe5-e78c-4379-9178-e03bd4fae02b 1G" returned: 0 in 0.567s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-09d243d3-2c75-4767-8a46-6122d01be031 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e.310a7fe5-e78c-4379-9178-e03bd4fae02b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:12 devstack sudo[95220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e.310a7fe5-e78c-4379-9178-e03bd4fae02b Nov 04 18:54:12 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:12 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-09d243d3-2c75-4767-8a46-6122d01be031 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e.310a7fe5-e78c-4379-9178-e03bd4fae02b" returned: 0 in 0.412s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:12 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-09d243d3-2c75-4767-8a46-6122d01be031 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e.310a7fe5-e78c-4379-9178-e03bd4fae02b is being set with open permissions: ugo+rw Nov 04 18:54:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-09d243d3-2c75-4767-8a46-6122d01be031 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e.310a7fe5-e78c-4379-9178-e03bd4fae02b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:12 devstack sudo[95225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e.310a7fe5-e78c-4379-9178-e03bd4fae02b Nov 04 18:54:12 devstack sudo[95225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:12 devstack sudo[95225]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-09d243d3-2c75-4767-8a46-6122d01be031 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e.310a7fe5-e78c-4379-9178-e03bd4fae02b" returned: 0 in 0.296s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-09d243d3-2c75-4767-8a46-6122d01be031 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:12 devstack sudo[95228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e.info Nov 04 18:54:12 devstack sudo[95228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:13 devstack sudo[95228]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-09d243d3-2c75-4767-8a46-6122d01be031 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e.info" returned: 0 in 0.340s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:13 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-09d243d3-2c75-4767-8a46-6122d01be031 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e.info is being set with open permissions: ugo+rw Nov 04 18:54:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-09d243d3-2c75-4767-8a46-6122d01be031 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:13 devstack sudo[95231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e.info Nov 04 18:54:13 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:13 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-09d243d3-2c75-4767-8a46-6122d01be031 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e.info" returned: 0 in 0.289s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-09d243d3-2c75-4767-8a46-6122d01be031 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.607s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:13 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-09d243d3-2c75-4767-8a46-6122d01be031 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Create snapshot completed successfully Nov 04 18:54:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e6b7d1ee-bc7e-4437-ab68-597982adbc09 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Acquiring lock "cinder-310a7fe5-e78c-4379-9178-e03bd4fae02b-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e6b7d1ee-bc7e-4437-ab68-597982adbc09 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Lock "cinder-310a7fe5-e78c-4379-9178-e03bd4fae02b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e6b7d1ee-bc7e-4437-ab68-597982adbc09 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Acquiring lock "cinder-quobyte-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e6b7d1ee-bc7e-4437-ab68-597982adbc09 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Lock "cinder-quobyte-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e6b7d1ee-bc7e-4437-ab68-597982adbc09 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Acquiring lock "cinder-quobyte-310a7fe5-e78c-4379-9178-e03bd4fae02b" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:15 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e6b7d1ee-bc7e-4437-ab68-597982adbc09 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Lock "cinder-quobyte-310a7fe5-e78c-4379-9178-e03bd4fae02b" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:15 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-e6b7d1ee-bc7e-4437-ab68-597982adbc09 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Deleting offline snapshot 310a7fe5-e78c-4379-9178-e03bd4fae02b of volume 07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:54:15 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-e6b7d1ee-bc7e-4437-ab68-597982adbc09 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] snapshot_file for this snap is: volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e.310a7fe5-e78c-4379-9178-e03bd4fae02b {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:54:15 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89b9b3c-8e23-49b6-98b7-2accb90cb4ff]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:54:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e6b7d1ee-bc7e-4437-ab68-597982adbc09 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e.310a7fe5-e78c-4379-9178-e03bd4fae02b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:15 devstack sudo[95256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e.310a7fe5-e78c-4379-9178-e03bd4fae02b Nov 04 18:54:15 devstack sudo[95256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:15 devstack sudo[95256]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e6b7d1ee-bc7e-4437-ab68-597982adbc09 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e.310a7fe5-e78c-4379-9178-e03bd4fae02b" returned: 0 in 0.568s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:15 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-e6b7d1ee-bc7e-4437-ab68-597982adbc09 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:54:15 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a3bfa4-051b-4e18-aaab-ee1ed52ef20d]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:54:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e6b7d1ee-bc7e-4437-ab68-597982adbc09 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:15 devstack sudo[95264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e Nov 04 18:54:15 devstack sudo[95264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:16 devstack sudo[95264]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e6b7d1ee-bc7e-4437-ab68-597982adbc09 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e" returned: 0 in 0.610s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e6b7d1ee-bc7e-4437-ab68-597982adbc09 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e.310a7fe5-e78c-4379-9178-e03bd4fae02b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:16 devstack sudo[95273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e.310a7fe5-e78c-4379-9178-e03bd4fae02b Nov 04 18:54:16 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:17 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e6b7d1ee-bc7e-4437-ab68-597982adbc09 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e.310a7fe5-e78c-4379-9178-e03bd4fae02b" returned: 0 in 0.781s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e6b7d1ee-bc7e-4437-ab68-597982adbc09 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e.310a7fe5-e78c-4379-9178-e03bd4fae02b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:17 devstack sudo[95281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e.310a7fe5-e78c-4379-9178-e03bd4fae02b Nov 04 18:54:17 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:17 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e6b7d1ee-bc7e-4437-ab68-597982adbc09 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e.310a7fe5-e78c-4379-9178-e03bd4fae02b" returned: 0 in 0.338s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:17 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e6b7d1ee-bc7e-4437-ab68-597982adbc09 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Lock "cinder-quobyte-310a7fe5-e78c-4379-9178-e03bd4fae02b" released by "_delete_snapshot" :: held 2.522s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:54:17 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e6b7d1ee-bc7e-4437-ab68-597982adbc09 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Lock "cinder-quobyte-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e" released by "delete_snapshot" :: held 2.577s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:54:17 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-e6b7d1ee-bc7e-4437-ab68-597982adbc09 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Created reservations ['02a07777-d040-4a91-97ad-6a65f215f5bc', '4e7b5af6-616d-4abc-becd-b60c477a00c2', 'f0a34b0f-c186-4c10-a6e5-5ccbb48d21e6', '84fcabcf-301a-4002-87da-30aaa209ec7c'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:54:17 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e6b7d1ee-bc7e-4437-ab68-597982adbc09 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Delete snapshot completed successfully. Nov 04 18:54:17 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e6b7d1ee-bc7e-4437-ab68-597982adbc09 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Lock "cinder-310a7fe5-e78c-4379-9178-e03bd4fae02b-delete_snapshot" released by "delete_snapshot" :: held 2.794s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:54:18 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1464c991-9bfe-495b-b835-d76119df1683 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Acquiring lock "cinder-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:18 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1464c991-9bfe-495b-b835-d76119df1683 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Lock "cinder-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:18 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1464c991-9bfe-495b-b835-d76119df1683 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Acquiring lock "cinder-quobyte-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:18 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1464c991-9bfe-495b-b835-d76119df1683 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Lock "cinder-quobyte-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e" acquired by "delete_volume" :: waited 0.024s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:18 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[021b52c4-a891-46fc-8262-024a6ccff056]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:54:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1464c991-9bfe-495b-b835-d76119df1683 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:18 devstack sudo[95284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e Nov 04 18:54:18 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:19 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1464c991-9bfe-495b-b835-d76119df1683 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e" returned: 0 in 0.511s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1464c991-9bfe-495b-b835-d76119df1683 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:19 devstack sudo[95289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e Nov 04 18:54:19 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:19 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1464c991-9bfe-495b-b835-d76119df1683 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e" returned: 0 in 0.311s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:19 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1464c991-9bfe-495b-b835-d76119df1683 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Lock "cinder-quobyte-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e" released by "delete_volume" :: held 0.937s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:54:19 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-1464c991-9bfe-495b-b835-d76119df1683 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Created reservations ['66fd4183-f0bb-4e8e-b288-ec9276abaeb4', 'ca83992f-7306-4e1b-b26b-0869a8683ce9', 'f68eb393-740f-438d-8c0a-18d4677987f6', '137f2f61-39de-44bc-b1a5-f9c4ac50c082'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:54:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1464c991-9bfe-495b-b835-d76119df1683 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1464c991-9bfe-495b-b835-d76119df1683 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:19 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1464c991-9bfe-495b-b835-d76119df1683 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:54:19 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1464c991-9bfe-495b-b835-d76119df1683 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:54:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1464c991-9bfe-495b-b835-d76119df1683 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1464c991-9bfe-495b-b835-d76119df1683 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:19 devstack sudo[95292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:54:19 devstack sudo[95292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:19 devstack sudo[95292]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1464c991-9bfe-495b-b835-d76119df1683 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.300s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:19 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-1464c991-9bfe-495b-b835-d76119df1683 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:54:19 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-1464c991-9bfe-495b-b835-d76119df1683 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Deleted volume successfully. Nov 04 18:54:19 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1464c991-9bfe-495b-b835-d76119df1683 tempest-VolumeSnapshotQuotasNegativeTestJSON-120535931 None] Lock "cinder-07d2b947-7aa6-4805-9f3f-3fb0bb38aa6e-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:54:20 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:54:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Flow 'volume_create_manager' (e57f8ea5-4cc5-4f59-9223-b665d31794c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:54:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62673f6a-e166-4952-9bcd-56c0cbf0e6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62673f6a-e166-4952-9bcd-56c0cbf0e6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1404106884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9cd0052-20ae-417b-bbe4-ba4431c8b539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d1b15ed32546a19fc1b5d7d3238d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:54:20Z,use_quota=True,user_id='4126b6f347f74b9c8e2c9083d24744b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a603c265-06fd-4752-a580-59bfc102c626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a603c265-06fd-4752-a580-59bfc102c626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34217f27-54ba-4d7e-a70b-420eb73aa4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34217f27-54ba-4d7e-a70b-420eb73aa4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9cd0052-20ae-417b-bbe4-ba4431c8b539', 'volume_name': 'volume-b9cd0052-20ae-417b-bbe4-ba4431c8b539', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8a788c-c002-47b7-a218-01259edb3518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8a788c-c002-47b7-a218-01259edb3518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44fe0478-d48f-4f6e-8bc2-fc2789992faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:20 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Volume b9cd0052-20ae-417b-bbe4-ba4431c8b539: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9cd0052-20ae-417b-bbe4-ba4431c8b539', 'volume_size': 1} Nov 04 18:54:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1404106884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9cd0052-20ae-417b-bbe4-ba4431c8b539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d1b15ed32546a19fc1b5d7d3238d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:54:20Z,use_quota=True,user_id='4126b6f347f74b9c8e2c9083d24744b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:54:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Creating volume b9cd0052-20ae-417b-bbe4-ba4431c8b539 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:54:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:54:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:54:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:54:20 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:54:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9cd0052-20ae-417b-bbe4-ba4431c8b539 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:20 devstack sudo[95295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9cd0052-20ae-417b-bbe4-ba4431c8b539 1073741824 Nov 04 18:54:20 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:20 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9cd0052-20ae-417b-bbe4-ba4431c8b539 1073741824" returned: 0 in 0.586s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9cd0052-20ae-417b-bbe4-ba4431c8b539 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:21 devstack sudo[95302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9cd0052-20ae-417b-bbe4-ba4431c8b539 Nov 04 18:54:21 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:21 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9cd0052-20ae-417b-bbe4-ba4431c8b539" returned: 0 in 0.320s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:21 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:54:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44fe0478-d48f-4f6e-8bc2-fc2789992faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9cd0052-20ae-417b-bbe4-ba4431c8b539', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f53e5b-53e2-428d-963e-59ebd75a54d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:21 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Volume volume-b9cd0052-20ae-417b-bbe4-ba4431c8b539 (b9cd0052-20ae-417b-bbe4-ba4431c8b539): created successfully Nov 04 18:54:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f53e5b-53e2-428d-963e-59ebd75a54d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Flow 'volume_create_manager' (e57f8ea5-4cc5-4f59-9223-b665d31794c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:54:21 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-0f82ecd7-0662-432e-8290-2501f0022eb7 tempest-VolumesTransfersV357Test-609891464 None] Created volume successfully. Nov 04 18:54:23 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-a1819933-87d6-494f-951c-dce651fab93a tempest-VolumesTransfersV357Test-823404312 None] Transfer volume completed successfully. Nov 04 18:54:24 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-161e3803-6f27-45de-98ad-5089b727cd1b tempest-VolumesTransfersV357Test-1951618737 None] Acquiring lock "cinder-b9cd0052-20ae-417b-bbe4-ba4431c8b539-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:24 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-161e3803-6f27-45de-98ad-5089b727cd1b tempest-VolumesTransfersV357Test-1951618737 None] Lock "cinder-b9cd0052-20ae-417b-bbe4-ba4431c8b539-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:24 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=102,cinder:UPDATE=143,cinder:INSERT=37,cinder:DELETE=8 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:54:24 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=105,cinder:UPDATE=125,cinder:INSERT=37,cinder:DELETE=15 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:54:24 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-161e3803-6f27-45de-98ad-5089b727cd1b tempest-VolumesTransfersV357Test-1951618737 None] Acquiring lock "cinder-quobyte-b9cd0052-20ae-417b-bbe4-ba4431c8b539" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:24 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-161e3803-6f27-45de-98ad-5089b727cd1b tempest-VolumesTransfersV357Test-1951618737 None] Lock "cinder-quobyte-b9cd0052-20ae-417b-bbe4-ba4431c8b539" acquired by "delete_volume" :: waited 0.024s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:24 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[25850d5e-bc99-4fbd-a9a8-4b4754bf6ee0]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:54:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-161e3803-6f27-45de-98ad-5089b727cd1b tempest-VolumesTransfersV357Test-1951618737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9cd0052-20ae-417b-bbe4-ba4431c8b539 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:24 devstack sudo[95305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9cd0052-20ae-417b-bbe4-ba4431c8b539 Nov 04 18:54:24 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:24 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-161e3803-6f27-45de-98ad-5089b727cd1b tempest-VolumesTransfersV357Test-1951618737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9cd0052-20ae-417b-bbe4-ba4431c8b539" returned: 0 in 0.454s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-161e3803-6f27-45de-98ad-5089b727cd1b tempest-VolumesTransfersV357Test-1951618737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9cd0052-20ae-417b-bbe4-ba4431c8b539 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:24 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9cd0052-20ae-417b-bbe4-ba4431c8b539 Nov 04 18:54:24 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:25 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-161e3803-6f27-45de-98ad-5089b727cd1b tempest-VolumesTransfersV357Test-1951618737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9cd0052-20ae-417b-bbe4-ba4431c8b539" returned: 0 in 0.417s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:25 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-161e3803-6f27-45de-98ad-5089b727cd1b tempest-VolumesTransfersV357Test-1951618737 None] Lock "cinder-quobyte-b9cd0052-20ae-417b-bbe4-ba4431c8b539" released by "delete_volume" :: held 0.933s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:54:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:54:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:54:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:54:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:25 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-161e3803-6f27-45de-98ad-5089b727cd1b tempest-VolumesTransfersV357Test-1951618737 None] Created reservations ['c159a92d-b499-44cb-839d-82670c095597', '071f6539-c418-4941-b0dd-81ea60dd649f', 'f97f53ba-28c0-4a07-9633-e50767afb779', '05c24868-e434-415f-a48e-5c6dd7826199'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:54:25 devstack sudo[95316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:54:25 devstack sudo[95316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-161e3803-6f27-45de-98ad-5089b727cd1b tempest-VolumesTransfersV357Test-1951618737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-161e3803-6f27-45de-98ad-5089b727cd1b tempest-VolumesTransfersV357Test-1951618737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-161e3803-6f27-45de-98ad-5089b727cd1b tempest-VolumesTransfersV357Test-1951618737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:54:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-161e3803-6f27-45de-98ad-5089b727cd1b tempest-VolumesTransfersV357Test-1951618737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:54:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-161e3803-6f27-45de-98ad-5089b727cd1b tempest-VolumesTransfersV357Test-1951618737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-161e3803-6f27-45de-98ad-5089b727cd1b tempest-VolumesTransfersV357Test-1951618737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:25 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:54:25 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:25 devstack sudo[95316]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.398s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:25 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:54:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager._thread_info {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:54:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread count: 28 {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:54:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread info: [<_MainThread(MainThread, started 130247852032128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:54:25 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-161e3803-6f27-45de-98ad-5089b727cd1b tempest-VolumesTransfersV357Test-1951618737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.358s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:25 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-161e3803-6f27-45de-98ad-5089b727cd1b tempest-VolumesTransfersV357Test-1951618737 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:54:25 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-161e3803-6f27-45de-98ad-5089b727cd1b tempest-VolumesTransfersV357Test-1951618737 None] Deleted volume successfully. Nov 04 18:54:25 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-161e3803-6f27-45de-98ad-5089b727cd1b tempest-VolumesTransfersV357Test-1951618737 None] Lock "cinder-b9cd0052-20ae-417b-bbe4-ba4431c8b539-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:54:27 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:54:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Flow 'volume_create_manager' (ca38f0cb-2a34-4f2d-adba-39b311b2a5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:54:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd50672-169b-4537-9d99-5fd63ff797a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd50672-169b-4537-9d99-5fd63ff797a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-575662429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61fcfdec-5ed8-4b8b-99b2-c42bd2ce476a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d1b15ed32546a19fc1b5d7d3238d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:54:27Z,use_quota=True,user_id='4126b6f347f74b9c8e2c9083d24744b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d32e227-f3b7-43a3-bb43-bbb6a2188463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d32e227-f3b7-43a3-bb43-bbb6a2188463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c3d2e63-1513-4c08-9e87-c77d37954b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c3d2e63-1513-4c08-9e87-c77d37954b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61fcfdec-5ed8-4b8b-99b2-c42bd2ce476a', 'volume_name': 'volume-61fcfdec-5ed8-4b8b-99b2-c42bd2ce476a', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62cae6e5-c208-484f-8547-ab952b1f15a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62cae6e5-c208-484f-8547-ab952b1f15a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de5febb7-9633-434a-9ec8-c8470c0dbe90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:27 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Volume 61fcfdec-5ed8-4b8b-99b2-c42bd2ce476a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61fcfdec-5ed8-4b8b-99b2-c42bd2ce476a', 'volume_size': 1} Nov 04 18:54:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:27 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-575662429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61fcfdec-5ed8-4b8b-99b2-c42bd2ce476a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d1b15ed32546a19fc1b5d7d3238d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:54:27Z,use_quota=True,user_id='4126b6f347f74b9c8e2c9083d24744b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:54:27 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Creating volume 61fcfdec-5ed8-4b8b-99b2-c42bd2ce476a {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:54:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:27 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:54:27 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:54:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:27 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:54:27 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:54:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-61fcfdec-5ed8-4b8b-99b2-c42bd2ce476a 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:27 devstack sudo[95335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-61fcfdec-5ed8-4b8b-99b2-c42bd2ce476a 1073741824 Nov 04 18:54:27 devstack sudo[95335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:28 devstack sudo[95335]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-61fcfdec-5ed8-4b8b-99b2-c42bd2ce476a 1073741824" returned: 0 in 0.693s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-61fcfdec-5ed8-4b8b-99b2-c42bd2ce476a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:28 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-61fcfdec-5ed8-4b8b-99b2-c42bd2ce476a Nov 04 18:54:28 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:28 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-61fcfdec-5ed8-4b8b-99b2-c42bd2ce476a" returned: 0 in 0.300s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:54:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de5febb7-9633-434a-9ec8-c8470c0dbe90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61fcfdec-5ed8-4b8b-99b2-c42bd2ce476a', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea7aaa31-7414-47bf-85dd-2733c61c2d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:28 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Volume volume-61fcfdec-5ed8-4b8b-99b2-c42bd2ce476a (61fcfdec-5ed8-4b8b-99b2-c42bd2ce476a): created successfully Nov 04 18:54:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea7aaa31-7414-47bf-85dd-2733c61c2d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Flow 'volume_create_manager' (ca38f0cb-2a34-4f2d-adba-39b311b2a5c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:54:28 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-bc54bca4-2469-4fd4-8062-37625a5232db tempest-VolumesTransfersV357Test-609891464 None] Created volume successfully. Nov 04 18:54:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-61ac2516-078a-430e-9584-a828aca20057 tempest-VolumesTransfersV357Test-1951618737 None] Acquiring lock "cinder-61fcfdec-5ed8-4b8b-99b2-c42bd2ce476a-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-61ac2516-078a-430e-9584-a828aca20057 tempest-VolumesTransfersV357Test-1951618737 None] Lock "cinder-61fcfdec-5ed8-4b8b-99b2-c42bd2ce476a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-61ac2516-078a-430e-9584-a828aca20057 tempest-VolumesTransfersV357Test-1951618737 None] Acquiring lock "cinder-quobyte-61fcfdec-5ed8-4b8b-99b2-c42bd2ce476a" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-61ac2516-078a-430e-9584-a828aca20057 tempest-VolumesTransfersV357Test-1951618737 None] Lock "cinder-quobyte-61fcfdec-5ed8-4b8b-99b2-c42bd2ce476a" acquired by "delete_volume" :: waited 0.025s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:30 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92a13f7-2f6c-4470-9d3d-cfba2cf62c63]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:54:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-61ac2516-078a-430e-9584-a828aca20057 tempest-VolumesTransfersV357Test-1951618737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-61fcfdec-5ed8-4b8b-99b2-c42bd2ce476a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:30 devstack sudo[95349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-61fcfdec-5ed8-4b8b-99b2-c42bd2ce476a Nov 04 18:54:30 devstack sudo[95349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:30 devstack sudo[95349]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-61ac2516-078a-430e-9584-a828aca20057 tempest-VolumesTransfersV357Test-1951618737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-61fcfdec-5ed8-4b8b-99b2-c42bd2ce476a" returned: 0 in 0.555s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-61ac2516-078a-430e-9584-a828aca20057 tempest-VolumesTransfersV357Test-1951618737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-61fcfdec-5ed8-4b8b-99b2-c42bd2ce476a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:30 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-61fcfdec-5ed8-4b8b-99b2-c42bd2ce476a Nov 04 18:54:30 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:31 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-61ac2516-078a-430e-9584-a828aca20057 tempest-VolumesTransfersV357Test-1951618737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-61fcfdec-5ed8-4b8b-99b2-c42bd2ce476a" returned: 0 in 0.455s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:31 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-61ac2516-078a-430e-9584-a828aca20057 tempest-VolumesTransfersV357Test-1951618737 None] Lock "cinder-quobyte-61fcfdec-5ed8-4b8b-99b2-c42bd2ce476a" released by "delete_volume" :: held 1.085s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:54:31 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-61ac2516-078a-430e-9584-a828aca20057 tempest-VolumesTransfersV357Test-1951618737 None] Created reservations ['38de001c-7b5d-49ac-9a37-b5b03a46822f', '4009cf48-750a-4f2f-ba1a-432e5a854fa0', '487d1d25-caea-41f3-b4e6-e8a78a793309', '80c99294-3a08-4b39-80d6-85cfbab6b4d6'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:54:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-61ac2516-078a-430e-9584-a828aca20057 tempest-VolumesTransfersV357Test-1951618737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-61ac2516-078a-430e-9584-a828aca20057 tempest-VolumesTransfersV357Test-1951618737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-61ac2516-078a-430e-9584-a828aca20057 tempest-VolumesTransfersV357Test-1951618737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:54:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-61ac2516-078a-430e-9584-a828aca20057 tempest-VolumesTransfersV357Test-1951618737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:54:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-61ac2516-078a-430e-9584-a828aca20057 tempest-VolumesTransfersV357Test-1951618737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-61ac2516-078a-430e-9584-a828aca20057 tempest-VolumesTransfersV357Test-1951618737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:31 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:54:31 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:31 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-61ac2516-078a-430e-9584-a828aca20057 tempest-VolumesTransfersV357Test-1951618737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.560s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:31 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-61ac2516-078a-430e-9584-a828aca20057 tempest-VolumesTransfersV357Test-1951618737 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:54:32 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-61ac2516-078a-430e-9584-a828aca20057 tempest-VolumesTransfersV357Test-1951618737 None] Deleted volume successfully. Nov 04 18:54:32 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-61ac2516-078a-430e-9584-a828aca20057 tempest-VolumesTransfersV357Test-1951618737 None] Lock "cinder-61fcfdec-5ed8-4b8b-99b2-c42bd2ce476a-delete_volume" released by "delete_volume" :: held 2.010s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:54:34 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:54:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Flow 'volume_create_manager' (066d04a0-d04b-4a99-be75-485eb9da4490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:54:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05e0858c-089b-4c07-8889-a77013b00fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05e0858c-089b-4c07-8889-a77013b00fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1303017817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b357eb-b5a6-4a70-a275-c779c810b88b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be56dc86c6134d62a0bb36ba25256942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:54:35Z,use_quota=True,user_id='90e16370f5334c04a94205df5adddde2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81f037e9-754d-4327-8011-4e0f368f2c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81f037e9-754d-4327-8011-4e0f368f2c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba91013-e673-477e-9fcd-329f57be5e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba91013-e673-477e-9fcd-329f57be5e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12b357eb-b5a6-4a70-a275-c779c810b88b', 'volume_name': 'volume-12b357eb-b5a6-4a70-a275-c779c810b88b', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3615f3d6-639d-4712-bb31-66a5ce2a70f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3615f3d6-639d-4712-bb31-66a5ce2a70f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (956da647-a2bf-4805-aa70-dec7313cb71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:34 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Volume 12b357eb-b5a6-4a70-a275-c779c810b88b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12b357eb-b5a6-4a70-a275-c779c810b88b', 'volume_size': 1} Nov 04 18:54:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1303017817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b357eb-b5a6-4a70-a275-c779c810b88b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be56dc86c6134d62a0bb36ba25256942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:54:35Z,use_quota=True,user_id='90e16370f5334c04a94205df5adddde2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:54:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Creating volume 12b357eb-b5a6-4a70-a275-c779c810b88b {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:54:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:54:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:54:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:54:34 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:54:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:34 devstack sudo[95431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b 1073741824 Nov 04 18:54:34 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:35 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b 1073741824" returned: 0 in 0.706s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:35 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b Nov 04 18:54:35 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:35 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b" returned: 0 in 0.380s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:35 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:54:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (956da647-a2bf-4805-aa70-dec7313cb71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12b357eb-b5a6-4a70-a275-c779c810b88b', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1f796d8-f039-4955-bf91-ec601149174d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:35 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Volume volume-12b357eb-b5a6-4a70-a275-c779c810b88b (12b357eb-b5a6-4a70-a275-c779c810b88b): created successfully Nov 04 18:54:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1f796d8-f039-4955-bf91-ec601149174d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Flow 'volume_create_manager' (066d04a0-d04b-4a99-be75-485eb9da4490) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:54:35 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-c2b32439-6ae1-4c0c-aaae-ba6cc551998f tempest-VolumesSnapshotTestJSON-1967794390 None] Created volume successfully. Nov 04 18:54:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1e2f4fe6-1ced-43bc-a789-3e5c0d830d0a tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1e2f4fe6-1ced-43bc-a789-3e5c0d830d0a tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-1e2f4fe6-1ced-43bc-a789-3e5c0d830d0a tempest-VolumesSnapshotTestJSON-1967794390 None] Creating offline snapshot ac241ef7-4562-42a7-b7ba-a2d5ab4d8053 of volume 12b357eb-b5a6-4a70-a275-c779c810b88b {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:54:37 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e910a9-8e9f-4d11-a5d4-3493319e4734]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:54:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1e2f4fe6-1ced-43bc-a789-3e5c0d830d0a tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:37 devstack sudo[95447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b Nov 04 18:54:37 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:38 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1e2f4fe6-1ced-43bc-a789-3e5c0d830d0a tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b" returned: 0 in 0.710s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1e2f4fe6-1ced-43bc-a789-3e5c0d830d0a tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b.ac241ef7-4562-42a7-b7ba-a2d5ab4d8053 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:38 devstack sudo[95453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b.ac241ef7-4562-42a7-b7ba-a2d5ab4d8053 1G Nov 04 18:54:38 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:39 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1e2f4fe6-1ced-43bc-a789-3e5c0d830d0a tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b.ac241ef7-4562-42a7-b7ba-a2d5ab4d8053 1G" returned: 0 in 0.714s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1e2f4fe6-1ced-43bc-a789-3e5c0d830d0a tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b357eb-b5a6-4a70-a275-c779c810b88b -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b.ac241ef7-4562-42a7-b7ba-a2d5ab4d8053 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:39 devstack sudo[95460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b357eb-b5a6-4a70-a275-c779c810b88b -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b.ac241ef7-4562-42a7-b7ba-a2d5ab4d8053 Nov 04 18:54:39 devstack sudo[95460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:39 devstack sudo[95460]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1e2f4fe6-1ced-43bc-a789-3e5c0d830d0a tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b357eb-b5a6-4a70-a275-c779c810b88b -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b.ac241ef7-4562-42a7-b7ba-a2d5ab4d8053" returned: 0 in 0.444s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:39 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-1e2f4fe6-1ced-43bc-a789-3e5c0d830d0a tempest-VolumesSnapshotTestJSON-1967794390 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b.ac241ef7-4562-42a7-b7ba-a2d5ab4d8053 is being set with open permissions: ugo+rw Nov 04 18:54:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1e2f4fe6-1ced-43bc-a789-3e5c0d830d0a tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b.ac241ef7-4562-42a7-b7ba-a2d5ab4d8053 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:39 devstack sudo[95470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b.ac241ef7-4562-42a7-b7ba-a2d5ab4d8053 Nov 04 18:54:39 devstack sudo[95470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:39 devstack sudo[95470]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1e2f4fe6-1ced-43bc-a789-3e5c0d830d0a tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b.ac241ef7-4562-42a7-b7ba-a2d5ab4d8053" returned: 0 in 0.326s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1e2f4fe6-1ced-43bc-a789-3e5c0d830d0a tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:39 devstack sudo[95473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b.info Nov 04 18:54:39 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:40 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1e2f4fe6-1ced-43bc-a789-3e5c0d830d0a tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b.info" returned: 0 in 0.481s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:40 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-1e2f4fe6-1ced-43bc-a789-3e5c0d830d0a tempest-VolumesSnapshotTestJSON-1967794390 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b.info is being set with open permissions: ugo+rw Nov 04 18:54:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1e2f4fe6-1ced-43bc-a789-3e5c0d830d0a tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:40 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b.info Nov 04 18:54:40 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:40 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1e2f4fe6-1ced-43bc-a789-3e5c0d830d0a tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b.info" returned: 0 in 0.421s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1e2f4fe6-1ced-43bc-a789-3e5c0d830d0a tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.260s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:40 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-1e2f4fe6-1ced-43bc-a789-3e5c0d830d0a tempest-VolumesSnapshotTestJSON-1967794390 None] Create snapshot completed successfully Nov 04 18:54:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4ca5cb4b-28ce-43b9-b52c-b5f479da121c tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "cinder-ac241ef7-4562-42a7-b7ba-a2d5ab4d8053-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4ca5cb4b-28ce-43b9-b52c-b5f479da121c tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-ac241ef7-4562-42a7-b7ba-a2d5ab4d8053-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4ca5cb4b-28ce-43b9-b52c-b5f479da121c tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "cinder-quobyte-12b357eb-b5a6-4a70-a275-c779c810b88b" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4ca5cb4b-28ce-43b9-b52c-b5f479da121c tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-12b357eb-b5a6-4a70-a275-c779c810b88b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4ca5cb4b-28ce-43b9-b52c-b5f479da121c tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "cinder-quobyte-ac241ef7-4562-42a7-b7ba-a2d5ab4d8053" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4ca5cb4b-28ce-43b9-b52c-b5f479da121c tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-ac241ef7-4562-42a7-b7ba-a2d5ab4d8053" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:42 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-4ca5cb4b-28ce-43b9-b52c-b5f479da121c tempest-VolumesSnapshotTestJSON-1967794390 None] Deleting offline snapshot ac241ef7-4562-42a7-b7ba-a2d5ab4d8053 of volume 12b357eb-b5a6-4a70-a275-c779c810b88b {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:54:42 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-4ca5cb4b-28ce-43b9-b52c-b5f479da121c tempest-VolumesSnapshotTestJSON-1967794390 None] snapshot_file for this snap is: volume-12b357eb-b5a6-4a70-a275-c779c810b88b.ac241ef7-4562-42a7-b7ba-a2d5ab4d8053 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:54:42 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5657333-aef7-425b-9bfd-cc0d424686f6]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:54:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4ca5cb4b-28ce-43b9-b52c-b5f479da121c tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b.ac241ef7-4562-42a7-b7ba-a2d5ab4d8053 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:42 devstack sudo[95479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b.ac241ef7-4562-42a7-b7ba-a2d5ab4d8053 Nov 04 18:54:42 devstack sudo[95479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:42 devstack sudo[95479]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4ca5cb4b-28ce-43b9-b52c-b5f479da121c tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b.ac241ef7-4562-42a7-b7ba-a2d5ab4d8053" returned: 0 in 0.567s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:42 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-4ca5cb4b-28ce-43b9-b52c-b5f479da121c tempest-VolumesSnapshotTestJSON-1967794390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12b357eb-b5a6-4a70-a275-c779c810b88b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:54:42 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fa8996-f5fc-4fdb-a131-bd329829ad00]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:54:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4ca5cb4b-28ce-43b9-b52c-b5f479da121c tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:43 devstack sudo[95484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b Nov 04 18:54:43 devstack sudo[95484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:43 devstack sudo[95484]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4ca5cb4b-28ce-43b9-b52c-b5f479da121c tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b" returned: 0 in 0.515s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4ca5cb4b-28ce-43b9-b52c-b5f479da121c tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b.ac241ef7-4562-42a7-b7ba-a2d5ab4d8053 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:43 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b.ac241ef7-4562-42a7-b7ba-a2d5ab4d8053 Nov 04 18:54:43 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:44 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4ca5cb4b-28ce-43b9-b52c-b5f479da121c tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b.ac241ef7-4562-42a7-b7ba-a2d5ab4d8053" returned: 0 in 0.728s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4ca5cb4b-28ce-43b9-b52c-b5f479da121c tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b.ac241ef7-4562-42a7-b7ba-a2d5ab4d8053 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:44 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b.ac241ef7-4562-42a7-b7ba-a2d5ab4d8053 Nov 04 18:54:44 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:44 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4ca5cb4b-28ce-43b9-b52c-b5f479da121c tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b.ac241ef7-4562-42a7-b7ba-a2d5ab4d8053" returned: 0 in 0.510s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4ca5cb4b-28ce-43b9-b52c-b5f479da121c tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-ac241ef7-4562-42a7-b7ba-a2d5ab4d8053" released by "_delete_snapshot" :: held 2.496s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:54:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4ca5cb4b-28ce-43b9-b52c-b5f479da121c tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-12b357eb-b5a6-4a70-a275-c779c810b88b" released by "delete_snapshot" :: held 2.539s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:54:44 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-4ca5cb4b-28ce-43b9-b52c-b5f479da121c tempest-VolumesSnapshotTestJSON-1967794390 None] Created reservations ['be481bfc-09f8-4f4c-8abb-846e985cc96c', '853ff5a8-d4dd-42ea-91d4-1a7dfeb78bec', 'a321e8ae-2ca9-406a-8d11-d7e4f3386786', '90c71910-9c44-419d-b091-0e8447216790'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:54:44 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-4ca5cb4b-28ce-43b9-b52c-b5f479da121c tempest-VolumesSnapshotTestJSON-1967794390 None] Delete snapshot completed successfully. Nov 04 18:54:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4ca5cb4b-28ce-43b9-b52c-b5f479da121c tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-ac241ef7-4562-42a7-b7ba-a2d5ab4d8053-delete_snapshot" released by "delete_snapshot" :: held 2.819s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:54:46 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:54:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Flow 'volume_create_manager' (c51714ad-b4ee-4411-92e8-4e59a0742b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:54:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe05132-ae4d-45cc-b1c4-d62c747b9b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe05132-ae4d-45cc-b1c4-d62c747b9b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-936451185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d7609f-f655-4c34-a94e-9f1c6d81d20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be56dc86c6134d62a0bb36ba25256942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:54:46Z,use_quota=True,user_id='90e16370f5334c04a94205df5adddde2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6616fd-f9b1-49d8-bd46-2593e7006cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6616fd-f9b1-49d8-bd46-2593e7006cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a8ab04-b70c-4ff2-8ac2-c05a73da3d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a8ab04-b70c-4ff2-8ac2-c05a73da3d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2d7609f-f655-4c34-a94e-9f1c6d81d20b', 'volume_name': 'volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de3d78e-fa4d-438b-a14e-431b9a344333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de3d78e-fa4d-438b-a14e-431b9a344333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cbd2267-6de9-43a0-8af3-b43ffb85b646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:46 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Volume d2d7609f-f655-4c34-a94e-9f1c6d81d20b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b', 'volume_size': 1} Nov 04 18:54:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-936451185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d7609f-f655-4c34-a94e-9f1c6d81d20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be56dc86c6134d62a0bb36ba25256942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:54:46Z,use_quota=True,user_id='90e16370f5334c04a94205df5adddde2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:54:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Creating volume d2d7609f-f655-4c34-a94e-9f1c6d81d20b {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:54:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:54:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:54:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:54:46 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:54:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:46 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b 1073741824 Nov 04 18:54:46 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:46 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b 1073741824" returned: 0 in 0.507s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:46 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b Nov 04 18:54:46 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:47 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b" returned: 0 in 0.278s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:54:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cbd2267-6de9-43a0-8af3-b43ffb85b646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3105e592-d139-49fc-b169-dfec4c319687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:47 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Volume volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b (d2d7609f-f655-4c34-a94e-9f1c6d81d20b): created successfully Nov 04 18:54:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3105e592-d139-49fc-b169-dfec4c319687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Flow 'volume_create_manager' (c51714ad-b4ee-4411-92e8-4e59a0742b37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:54:47 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-5fce8647-bd17-4c5c-8870-c4b92256c20c tempest-VolumesSnapshotTestJSON-1967794390 None] Created volume successfully. Nov 04 18:54:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f55d7b0d-6535-49cb-811d-507045832132 tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f55d7b0d-6535-49cb-811d-507045832132 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-f55d7b0d-6535-49cb-811d-507045832132 tempest-VolumesSnapshotTestJSON-1967794390 None] Creating offline snapshot d3e1e933-9a04-47c4-930f-a41b37233d37 of volume d2d7609f-f655-4c34-a94e-9f1c6d81d20b {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:54:48 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[43166726-5ede-4001-8e6f-5c38d527310b]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:54:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55d7b0d-6535-49cb-811d-507045832132 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:48 devstack sudo[95564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b Nov 04 18:54:48 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:49 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55d7b0d-6535-49cb-811d-507045832132 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b" returned: 0 in 0.451s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55d7b0d-6535-49cb-811d-507045832132 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.d3e1e933-9a04-47c4-930f-a41b37233d37 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:49 devstack sudo[95569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.d3e1e933-9a04-47c4-930f-a41b37233d37 1G Nov 04 18:54:49 devstack sudo[95569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:49 devstack sudo[95569]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55d7b0d-6535-49cb-811d-507045832132 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.d3e1e933-9a04-47c4-930f-a41b37233d37 1G" returned: 0 in 0.491s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55d7b0d-6535-49cb-811d-507045832132 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.d3e1e933-9a04-47c4-930f-a41b37233d37 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:49 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.d3e1e933-9a04-47c4-930f-a41b37233d37 Nov 04 18:54:49 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:49 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55d7b0d-6535-49cb-811d-507045832132 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.d3e1e933-9a04-47c4-930f-a41b37233d37" returned: 0 in 0.382s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:49 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-f55d7b0d-6535-49cb-811d-507045832132 tempest-VolumesSnapshotTestJSON-1967794390 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.d3e1e933-9a04-47c4-930f-a41b37233d37 is being set with open permissions: ugo+rw Nov 04 18:54:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55d7b0d-6535-49cb-811d-507045832132 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.d3e1e933-9a04-47c4-930f-a41b37233d37 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:49 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.d3e1e933-9a04-47c4-930f-a41b37233d37 Nov 04 18:54:49 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:50 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55d7b0d-6535-49cb-811d-507045832132 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.d3e1e933-9a04-47c4-930f-a41b37233d37" returned: 0 in 0.290s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55d7b0d-6535-49cb-811d-507045832132 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:50 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.info Nov 04 18:54:50 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:50 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55d7b0d-6535-49cb-811d-507045832132 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.info" returned: 0 in 0.327s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:50 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-f55d7b0d-6535-49cb-811d-507045832132 tempest-VolumesSnapshotTestJSON-1967794390 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.info is being set with open permissions: ugo+rw Nov 04 18:54:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55d7b0d-6535-49cb-811d-507045832132 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:50 devstack sudo[95586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.info Nov 04 18:54:50 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:50 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55d7b0d-6535-49cb-811d-507045832132 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.info" returned: 0 in 0.312s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f55d7b0d-6535-49cb-811d-507045832132 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.379s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:50 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-f55d7b0d-6535-49cb-811d-507045832132 tempest-VolumesSnapshotTestJSON-1967794390 None] Create snapshot completed successfully Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Flow 'volume_create_manager' (a1ec1fa9-f8d5-45a9-859f-e0129537fd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a65bbf4d-65b6-4d51-b253-28b509f25897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a65bbf4d-65b6-4d51-b253-28b509f25897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-313010981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149f9f54-37ee-4ca3-bbda-29ce4be5e296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be56dc86c6134d62a0bb36ba25256942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:54:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=d3e1e933-9a04-47c4-930f-a41b37233d37,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:54:52Z,use_quota=True,user_id='90e16370f5334c04a94205df5adddde2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e1f1bcd-b764-43d2-af01-fd94cb07aa80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e1f1bcd-b764-43d2-af01-fd94cb07aa80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e088b0-3902-4f01-8de3-18feb188a07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e088b0-3902-4f01-8de3-18feb188a07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '149f9f54-37ee-4ca3-bbda-29ce4be5e296', 'volume_name': 'volume-149f9f54-37ee-4ca3-bbda-29ce4be5e296', 'volume_size': 2, 'snapshot_id': 'd3e1e933-9a04-47c4-930f-a41b37233d37'}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70c1021a-a0e5-45f9-9e58-d7fffd4ec0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70c1021a-a0e5-45f9-9e58-d7fffd4ec0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07006f98-862b-4920-b3a8-8e79aad57c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:52 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Volume 149f9f54-37ee-4ca3-bbda-29ce4be5e296: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-149f9f54-37ee-4ca3-bbda-29ce4be5e296', 'volume_size': 2, 'snapshot_id': 'd3e1e933-9a04-47c4-930f-a41b37233d37'} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "cinder-quobyte-d3e1e933-9a04-47c4-930f-a41b37233d37-149f9f54-37ee-4ca3-bbda-29ce4be5e296" by "_create_volume_from_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-d3e1e933-9a04-47c4-930f-a41b37233d37-149f9f54-37ee-4ca3-bbda-29ce4be5e296" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Creating volume 149f9f54-37ee-4ca3-bbda-29ce4be5e296 from snapshot d3e1e933-9a04-47c4-930f-a41b37233d37 {{(pid=87119) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "cinder-quobyte-149f9f54-37ee-4ca3-bbda-29ce4be5e296" by "_copy_volume_from_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-149f9f54-37ee-4ca3-bbda-29ce4be5e296" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] snapshot: d3e1e933-9a04-47c4-930f-a41b37233d37, volume: 149f9f54-37ee-4ca3-bbda-29ce4be5e296, {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6a23a0-71de-4836-9e5c-459afdf1e85d]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:54:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.d3e1e933-9a04-47c4-930f-a41b37233d37 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:52 devstack sudo[95589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.d3e1e933-9a04-47c4-930f-a41b37233d37 Nov 04 18:54:52 devstack sudo[95589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:53 devstack sudo[95589]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.d3e1e933-9a04-47c4-930f-a41b37233d37" returned: 0 in 0.435s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:53 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:54:53 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f635587-91ad-477e-8eb6-fc555d1370d4]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:54:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:53 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b Nov 04 18:54:53 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:53 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b" returned: 0 in 0.514s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:53 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 18:54:53 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Creating direct copy from snapshot {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 18:54:53 devstack cinder-volume[87119]: DEBUG cinder.utils [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Path /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-149f9f54-37ee-4ca3-bbda-29ce4be5e296 not found in is_blk_device check {{(pid=87119) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 18:54:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-149f9f54-37ee-4ca3-bbda-29ce4be5e296 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:53 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-149f9f54-37ee-4ca3-bbda-29ce4be5e296 Nov 04 18:54:53 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:54 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:54:54 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Flow 'volume_create_manager' (60a05baf-5117-4c72-9ddf-8574f65418bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:54:54 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec18f2c-2817-4ca4-b8ed-17921f6a4bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec18f2c-2817-4ca4-b8ed-17921f6a4bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1131407112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13c504c7-2402-44c6-a086-d673b18ee667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28cd996caa3144c28e2089e5e92922f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:54:55Z,use_quota=True,user_id='b87b69f7f47a4ebea7ac87f7e72a6dd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc77086-5e63-4e42-b16f-05d8312eb0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc77086-5e63-4e42-b16f-05d8312eb0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a39b843-a832-451a-b05e-da6ddc1efff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a39b843-a832-451a-b05e-da6ddc1efff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13c504c7-2402-44c6-a086-d673b18ee667', 'volume_name': 'volume-13c504c7-2402-44c6-a086-d673b18ee667', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dada017-d59d-46da-b757-880ff9afc1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dada017-d59d-46da-b757-880ff9afc1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (888359b0-c542-4cbe-9b44-8bc6b5eaeea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:55 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Volume 13c504c7-2402-44c6-a086-d673b18ee667: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13c504c7-2402-44c6-a086-d673b18ee667', 'volume_size': 1} Nov 04 18:54:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:59 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:54:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Flow 'volume_create_manager' (e38f4885-8473-4965-b42d-050f6558c5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:54:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30449506-9b02-4356-92ea-b9eca6ee9d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30449506-9b02-4356-92ea-b9eca6ee9d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-92246637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f38801f1-69a1-4509-b7dd-cf92cb2fd3bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0059abb6e9e47e4a92600099aa32018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:54:59Z,use_quota=True,user_id='03f7a7ce52d5444baedd6a567e0e11be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109a86d4-083e-4808-9b79-edcb45649d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109a86d4-083e-4808-9b79-edcb45649d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502e7576-2dcc-40c4-bbaf-193cfd18bab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502e7576-2dcc-40c4-bbaf-193cfd18bab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f38801f1-69a1-4509-b7dd-cf92cb2fd3bb', 'volume_name': 'volume-f38801f1-69a1-4509-b7dd-cf92cb2fd3bb', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de560f9a-1dc1-406d-b208-ae5346515538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de560f9a-1dc1-406d-b208-ae5346515538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2dfe0df-0664-44af-ae93-f3080e5314a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:59 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Volume f38801f1-69a1-4509-b7dd-cf92cb2fd3bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f38801f1-69a1-4509-b7dd-cf92cb2fd3bb', 'volume_size': 1} Nov 04 18:54:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:02 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-149f9f54-37ee-4ca3-bbda-29ce4be5e296" returned: 0 in 8.970s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:02 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Image conversion details: src /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b, size 1024.00 MB, duration 8.97 sec, destination /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-149f9f54-37ee-4ca3-bbda-29ce4be5e296 {{(pid=87119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 18:55:02 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Converted 1024.00 MB image at 114.14 MB/s Nov 04 18:55:02 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-149f9f54-37ee-4ca3-bbda-29ce4be5e296 is being set with open permissions: ugo+rw Nov 04 18:55:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-149f9f54-37ee-4ca3-bbda-29ce4be5e296 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:02 devstack sudo[95619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-149f9f54-37ee-4ca3-bbda-29ce4be5e296 Nov 04 18:55:02 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:02 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-149f9f54-37ee-4ca3-bbda-29ce4be5e296" returned: 0 in 0.255s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:02 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-149f9f54-37ee-4ca3-bbda-29ce4be5e296" released by "_copy_volume_from_snapshot" :: held 10.290s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:02 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-d3e1e933-9a04-47c4-930f-a41b37233d37-149f9f54-37ee-4ca3-bbda-29ce4be5e296" released by "_create_volume_from_snapshot" :: held 10.368s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.390s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.927s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1131407112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13c504c7-2402-44c6-a086-d673b18ee667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28cd996caa3144c28e2089e5e92922f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:54:55Z,use_quota=True,user_id='b87b69f7f47a4ebea7ac87f7e72a6dd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:55:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Creating volume 13c504c7-2402-44c6-a086-d673b18ee667 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:55:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:55:03 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:55:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:03 devstack sudo[95624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667 1073741824 Nov 04 18:55:03 devstack sudo[95624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07006f98-862b-4920-b3a8-8e79aad57c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-149f9f54-37ee-4ca3-bbda-29ce4be5e296', 'volume_size': 2, 'snapshot_id': 'd3e1e933-9a04-47c4-930f-a41b37233d37'}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fd9f45-d223-41ea-80dd-63e97327919c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:03 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Volume volume-149f9f54-37ee-4ca3-bbda-29ce4be5e296 (149f9f54-37ee-4ca3-bbda-29ce4be5e296): created successfully Nov 04 18:55:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fd9f45-d223-41ea-80dd-63e97327919c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Flow 'volume_create_manager' (a1ec1fa9-f8d5-45a9-859f-e0129537fd7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:55:03 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-5bef22f6-05e6-40e2-a17a-8c40bca92ca1 tempest-VolumesSnapshotTestJSON-1967794390 None] Created volume successfully. Nov 04 18:55:03 devstack sudo[95624]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667 1073741824" returned: 0 in 0.470s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:03 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667 Nov 04 18:55:03 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:03 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667" returned: 0 in 0.262s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:55:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.347s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-92246637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f38801f1-69a1-4509-b7dd-cf92cb2fd3bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0059abb6e9e47e4a92600099aa32018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:54:59Z,use_quota=True,user_id='03f7a7ce52d5444baedd6a567e0e11be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:55:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Creating volume f38801f1-69a1-4509-b7dd-cf92cb2fd3bb {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:55:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:55:03 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:55:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f38801f1-69a1-4509-b7dd-cf92cb2fd3bb 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (888359b0-c542-4cbe-9b44-8bc6b5eaeea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13c504c7-2402-44c6-a086-d673b18ee667', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd8bfa2-5a65-4c8b-8efc-5b4cea9c730c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:03 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f38801f1-69a1-4509-b7dd-cf92cb2fd3bb 1073741824 Nov 04 18:55:03 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:03 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Volume volume-13c504c7-2402-44c6-a086-d673b18ee667 (13c504c7-2402-44c6-a086-d673b18ee667): created successfully Nov 04 18:55:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd8bfa2-5a65-4c8b-8efc-5b4cea9c730c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Flow 'volume_create_manager' (60a05baf-5117-4c72-9ddf-8574f65418bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:55:03 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-6f95d862-01f9-4e48-a1cf-242cbf4d939e tempest-VolumesActionsTest-1747258751 None] Created volume successfully. Nov 04 18:55:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-bf8fb19e-b4e3-4710-9db0-266a4057f176 tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "cinder-149f9f54-37ee-4ca3-bbda-29ce4be5e296-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-bf8fb19e-b4e3-4710-9db0-266a4057f176 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-149f9f54-37ee-4ca3-bbda-29ce4be5e296-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-bf8fb19e-b4e3-4710-9db0-266a4057f176 tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "cinder-quobyte-149f9f54-37ee-4ca3-bbda-29ce4be5e296" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-bf8fb19e-b4e3-4710-9db0-266a4057f176 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-149f9f54-37ee-4ca3-bbda-29ce4be5e296" acquired by "delete_volume" :: waited 0.016s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:04 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[620d4da5-c3b8-4f5c-ac59-afc8e5f59eac]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bf8fb19e-b4e3-4710-9db0-266a4057f176 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-149f9f54-37ee-4ca3-bbda-29ce4be5e296 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:04 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-149f9f54-37ee-4ca3-bbda-29ce4be5e296 Nov 04 18:55:04 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:04 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f38801f1-69a1-4509-b7dd-cf92cb2fd3bb 1073741824" returned: 0 in 0.562s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f38801f1-69a1-4509-b7dd-cf92cb2fd3bb {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:04 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f38801f1-69a1-4509-b7dd-cf92cb2fd3bb Nov 04 18:55:04 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:04 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bf8fb19e-b4e3-4710-9db0-266a4057f176 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-149f9f54-37ee-4ca3-bbda-29ce4be5e296" returned: 0 in 0.437s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bf8fb19e-b4e3-4710-9db0-266a4057f176 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-149f9f54-37ee-4ca3-bbda-29ce4be5e296 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:04 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-149f9f54-37ee-4ca3-bbda-29ce4be5e296 Nov 04 18:55:04 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:04 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f38801f1-69a1-4509-b7dd-cf92cb2fd3bb" returned: 0 in 0.379s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:04 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:55:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2dfe0df-0664-44af-ae93-f3080e5314a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f38801f1-69a1-4509-b7dd-cf92cb2fd3bb', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d05eb4f8-9eb3-4a8a-b560-e74f8eef0b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:04 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Volume volume-f38801f1-69a1-4509-b7dd-cf92cb2fd3bb (f38801f1-69a1-4509-b7dd-cf92cb2fd3bb): created successfully Nov 04 18:55:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d05eb4f8-9eb3-4a8a-b560-e74f8eef0b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Flow 'volume_create_manager' (e38f4885-8473-4965-b42d-050f6558c5df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:55:04 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-48dc3c43-c4fa-45b3-baa6-7bd93fcc4b60 tempest-AttachVolumeTestJSON-743042902 None] Created volume successfully. Nov 04 18:55:04 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bf8fb19e-b4e3-4710-9db0-266a4057f176 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-149f9f54-37ee-4ca3-bbda-29ce4be5e296" returned: 0 in 0.343s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-bf8fb19e-b4e3-4710-9db0-266a4057f176 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-149f9f54-37ee-4ca3-bbda-29ce4be5e296" released by "delete_volume" :: held 0.829s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:05 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-bf8fb19e-b4e3-4710-9db0-266a4057f176 tempest-VolumesSnapshotTestJSON-1967794390 None] Created reservations ['c5d5226a-bc2c-4ae0-9b94-e17b2e0d81da', '31b1c9a9-0631-40b8-85b7-9c8eed8bbc96', '3960da8d-fd99-4779-9a33-545603c6849e', '1c429635-ca64-48d4-a0b1-8278f163778d'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:55:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bf8fb19e-b4e3-4710-9db0-266a4057f176 tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bf8fb19e-b4e3-4710-9db0-266a4057f176 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bf8fb19e-b4e3-4710-9db0-266a4057f176 tempest-VolumesSnapshotTestJSON-1967794390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bf8fb19e-b4e3-4710-9db0-266a4057f176 tempest-VolumesSnapshotTestJSON-1967794390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bf8fb19e-b4e3-4710-9db0-266a4057f176 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bf8fb19e-b4e3-4710-9db0-266a4057f176 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:05 devstack sudo[95650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:55:05 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c3ac5361-def5-4164-920b-85dc09cefe2b tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "cinder-d3e1e933-9a04-47c4-930f-a41b37233d37-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c3ac5361-def5-4164-920b-85dc09cefe2b tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-d3e1e933-9a04-47c4-930f-a41b37233d37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c3ac5361-def5-4164-920b-85dc09cefe2b tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "cinder-quobyte-d2d7609f-f655-4c34-a94e-9f1c6d81d20b" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c3ac5361-def5-4164-920b-85dc09cefe2b tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-d2d7609f-f655-4c34-a94e-9f1c6d81d20b" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c3ac5361-def5-4164-920b-85dc09cefe2b tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "cinder-quobyte-d3e1e933-9a04-47c4-930f-a41b37233d37" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c3ac5361-def5-4164-920b-85dc09cefe2b tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-d3e1e933-9a04-47c4-930f-a41b37233d37" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-c3ac5361-def5-4164-920b-85dc09cefe2b tempest-VolumesSnapshotTestJSON-1967794390 None] Deleting offline snapshot d3e1e933-9a04-47c4-930f-a41b37233d37 of volume d2d7609f-f655-4c34-a94e-9f1c6d81d20b {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:55:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-c3ac5361-def5-4164-920b-85dc09cefe2b tempest-VolumesSnapshotTestJSON-1967794390 None] snapshot_file for this snap is: volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.d3e1e933-9a04-47c4-930f-a41b37233d37 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:55:05 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:05 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c19049-3fcd-4668-85e6-c31085b6cd5f]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c3ac5361-def5-4164-920b-85dc09cefe2b tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.d3e1e933-9a04-47c4-930f-a41b37233d37 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bf8fb19e-b4e3-4710-9db0-266a4057f176 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.351s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:05 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-bf8fb19e-b4e3-4710-9db0-266a4057f176 tempest-VolumesSnapshotTestJSON-1967794390 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:55:05 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-bf8fb19e-b4e3-4710-9db0-266a4057f176 tempest-VolumesSnapshotTestJSON-1967794390 None] Deleted volume successfully. Nov 04 18:55:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-bf8fb19e-b4e3-4710-9db0-266a4057f176 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-149f9f54-37ee-4ca3-bbda-29ce4be5e296-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:05 devstack sudo[95653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.d3e1e933-9a04-47c4-930f-a41b37233d37 Nov 04 18:55:05 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:05 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c3ac5361-def5-4164-920b-85dc09cefe2b tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.d3e1e933-9a04-47c4-930f-a41b37233d37" returned: 0 in 0.538s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-c3ac5361-def5-4164-920b-85dc09cefe2b tempest-VolumesSnapshotTestJSON-1967794390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:55:06 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1825fbe-4cae-4ca3-b67c-36c1ab8d0438]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c3ac5361-def5-4164-920b-85dc09cefe2b tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:06 devstack sudo[95665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b Nov 04 18:55:06 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:06 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c3ac5361-def5-4164-920b-85dc09cefe2b tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b" returned: 0 in 0.815s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c3ac5361-def5-4164-920b-85dc09cefe2b tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.d3e1e933-9a04-47c4-930f-a41b37233d37 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:06 devstack sudo[95672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.d3e1e933-9a04-47c4-930f-a41b37233d37 Nov 04 18:55:06 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:07 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c3ac5361-def5-4164-920b-85dc09cefe2b tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.d3e1e933-9a04-47c4-930f-a41b37233d37" returned: 0 in 0.629s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c3ac5361-def5-4164-920b-85dc09cefe2b tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.d3e1e933-9a04-47c4-930f-a41b37233d37 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-03fabfe0-6921-486e-ad70-98abafae021c req-76492eb2-ba46-4e13-97f8-b0c1b7566610 tempest-AttachVolumeTestJSON-743042902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-03fabfe0-6921-486e-ad70-98abafae021c req-76492eb2-ba46-4e13-97f8-b0c1b7566610 tempest-AttachVolumeTestJSON-743042902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:07 devstack sudo[95686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.d3e1e933-9a04-47c4-930f-a41b37233d37 Nov 04 18:55:07 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-03fabfe0-6921-486e-ad70-98abafae021c req-76492eb2-ba46-4e13-97f8-b0c1b7566610 tempest-AttachVolumeTestJSON-743042902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-03fabfe0-6921-486e-ad70-98abafae021c req-76492eb2-ba46-4e13-97f8-b0c1b7566610 tempest-AttachVolumeTestJSON-743042902 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280', 'name': 'volume-f38801f1-69a1-4509-b7dd-cf92cb2fd3bb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '78a01723-2fb5-4ba9-8c41-40fffb10449e', 'enforce_multipath': True} {{(pid=87119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:55:07 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-03fabfe0-6921-486e-ad70-98abafae021c req-76492eb2-ba46-4e13-97f8-b0c1b7566610 tempest-AttachVolumeTestJSON-743042902 None] attachment_update completed successfully. Nov 04 18:55:07 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c3ac5361-def5-4164-920b-85dc09cefe2b tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b.d3e1e933-9a04-47c4-930f-a41b37233d37" returned: 0 in 0.411s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c3ac5361-def5-4164-920b-85dc09cefe2b tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-d3e1e933-9a04-47c4-930f-a41b37233d37" released by "_delete_snapshot" :: held 2.613s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c3ac5361-def5-4164-920b-85dc09cefe2b tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-d2d7609f-f655-4c34-a94e-9f1c6d81d20b" released by "delete_snapshot" :: held 2.655s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:08 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-c3ac5361-def5-4164-920b-85dc09cefe2b tempest-VolumesSnapshotTestJSON-1967794390 None] Created reservations ['996f7d86-90f8-4792-94cb-e7f339fb3644', '188059e8-4d37-49fb-af24-57170a6c13d8', 'ace4c142-f5dc-451f-bdb3-d73dd4b16acf', '112259fd-928b-4e62-85ef-5e497edda475'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:55:08 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-c3ac5361-def5-4164-920b-85dc09cefe2b tempest-VolumesSnapshotTestJSON-1967794390 None] Delete snapshot completed successfully. Nov 04 18:55:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c3ac5361-def5-4164-920b-85dc09cefe2b tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-d3e1e933-9a04-47c4-930f-a41b37233d37-delete_snapshot" released by "delete_snapshot" :: held 3.121s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ea65583e-64a6-4be6-80fa-77273aea5dd0 tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "cinder-d2d7609f-f655-4c34-a94e-9f1c6d81d20b-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ea65583e-64a6-4be6-80fa-77273aea5dd0 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-d2d7609f-f655-4c34-a94e-9f1c6d81d20b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ea65583e-64a6-4be6-80fa-77273aea5dd0 tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "cinder-quobyte-d2d7609f-f655-4c34-a94e-9f1c6d81d20b" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ea65583e-64a6-4be6-80fa-77273aea5dd0 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-d2d7609f-f655-4c34-a94e-9f1c6d81d20b" acquired by "delete_volume" :: waited 0.027s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:08 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[049c08e4-00db-4274-b462-2dbf401c82e6]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ea65583e-64a6-4be6-80fa-77273aea5dd0 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:09 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b Nov 04 18:55:09 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:09 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ea65583e-64a6-4be6-80fa-77273aea5dd0 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b" returned: 0 in 0.550s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ea65583e-64a6-4be6-80fa-77273aea5dd0 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:09 devstack sudo[96455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b Nov 04 18:55:09 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:09 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ea65583e-64a6-4be6-80fa-77273aea5dd0 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d2d7609f-f655-4c34-a94e-9f1c6d81d20b" returned: 0 in 0.420s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ea65583e-64a6-4be6-80fa-77273aea5dd0 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-d2d7609f-f655-4c34-a94e-9f1c6d81d20b" released by "delete_volume" :: held 1.116s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-ea65583e-64a6-4be6-80fa-77273aea5dd0 tempest-VolumesSnapshotTestJSON-1967794390 None] Created reservations ['59f4f259-a852-4de7-84b4-8479f1633124', '9b7e862b-200e-4b5e-8aa7-352e1babfaf2', '5ee92d7d-cf01-4fd4-ac3c-8284ca2592b6', '505f31d9-fb06-4f5c-b6de-d7c53c3d83e2'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ea65583e-64a6-4be6-80fa-77273aea5dd0 tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ea65583e-64a6-4be6-80fa-77273aea5dd0 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ea65583e-64a6-4be6-80fa-77273aea5dd0 tempest-VolumesSnapshotTestJSON-1967794390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ea65583e-64a6-4be6-80fa-77273aea5dd0 tempest-VolumesSnapshotTestJSON-1967794390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ea65583e-64a6-4be6-80fa-77273aea5dd0 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ea65583e-64a6-4be6-80fa-77273aea5dd0 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:10 devstack sudo[96458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:55:10 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:10 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ea65583e-64a6-4be6-80fa-77273aea5dd0 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.439s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-ea65583e-64a6-4be6-80fa-77273aea5dd0 tempest-VolumesSnapshotTestJSON-1967794390 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:55:10 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-ea65583e-64a6-4be6-80fa-77273aea5dd0 tempest-VolumesSnapshotTestJSON-1967794390 None] Deleted volume successfully. Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ea65583e-64a6-4be6-80fa-77273aea5dd0 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-d2d7609f-f655-4c34-a94e-9f1c6d81d20b-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Flow 'volume_create_manager' (1fbc58b6-7c6c-46e5-8f0e-9d7bc3857b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c39549c4-2a20-47c8-a4e7-904b3ae7c90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c39549c4-2a20-47c8-a4e7-904b3ae7c90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1676984887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4e7424-f2f2-4629-ad01-7f762898887d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0059abb6e9e47e4a92600099aa32018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:55:11Z,use_quota=True,user_id='03f7a7ce52d5444baedd6a567e0e11be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3cbff46-2b71-421d-ab67-261a756872f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3cbff46-2b71-421d-ab67-261a756872f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f65ef06a-02b9-40f4-9d5f-9d9d2af24c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f65ef06a-02b9-40f4-9d5f-9d9d2af24c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d4e7424-f2f2-4629-ad01-7f762898887d', 'volume_name': 'volume-1d4e7424-f2f2-4629-ad01-7f762898887d', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3374f8-fd44-4f88-a8ec-c4fd7112caaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3374f8-fd44-4f88-a8ec-c4fd7112caaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b0c6eb-5fa3-4897-abab-9fead6c31ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:10 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Volume 1d4e7424-f2f2-4629-ad01-7f762898887d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d4e7424-f2f2-4629-ad01-7f762898887d', 'volume_size': 1} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1676984887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4e7424-f2f2-4629-ad01-7f762898887d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0059abb6e9e47e4a92600099aa32018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:55:11Z,use_quota=True,user_id='03f7a7ce52d5444baedd6a567e0e11be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Creating volume 1d4e7424-f2f2-4629-ad01-7f762898887d {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:55:10 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:55:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d4e7424-f2f2-4629-ad01-7f762898887d 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:11 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d4e7424-f2f2-4629-ad01-7f762898887d 1073741824 Nov 04 18:55:11 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:11 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d4e7424-f2f2-4629-ad01-7f762898887d 1073741824" returned: 0 in 0.864s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d4e7424-f2f2-4629-ad01-7f762898887d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:11 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d4e7424-f2f2-4629-ad01-7f762898887d Nov 04 18:55:11 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Flow 'volume_create_manager' (7ce71d86-04c3-41fc-9005-410bde9d9997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fde6e8a3-71d1-42ee-8144-5338150a7954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fde6e8a3-71d1-42ee-8144-5338150a7954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1757383865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903b7a66-b6c3-47b6-ab10-1be6a2742a11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be56dc86c6134d62a0bb36ba25256942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:55:12Z,use_quota=True,user_id='90e16370f5334c04a94205df5adddde2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb0ddbc-65f8-4f4d-9d32-7d34fab4f180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb0ddbc-65f8-4f4d-9d32-7d34fab4f180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36f65e01-4591-4561-a0ae-47fbd4a94c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36f65e01-4591-4561-a0ae-47fbd4a94c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '903b7a66-b6c3-47b6-ab10-1be6a2742a11', 'volume_name': 'volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10f5a7df-a78a-4bec-ab83-dc924662744b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10f5a7df-a78a-4bec-ab83-dc924662744b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb3d625-c82c-449e-940b-dcbef2032653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:12 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Volume 903b7a66-b6c3-47b6-ab10-1be6a2742a11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11', 'volume_size': 1} Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:12 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d4e7424-f2f2-4629-ad01-7f762898887d" returned: 0 in 0.369s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.173s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1757383865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903b7a66-b6c3-47b6-ab10-1be6a2742a11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be56dc86c6134d62a0bb36ba25256942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:55:12Z,use_quota=True,user_id='90e16370f5334c04a94205df5adddde2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Creating volume 903b7a66-b6c3-47b6-ab10-1be6a2742a11 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:12 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11 1073741824 Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:55:12 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:12 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b0c6eb-5fa3-4897-abab-9fead6c31ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d4e7424-f2f2-4629-ad01-7f762898887d', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc48bea-db29-4567-8999-aac1c138dda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:12 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Volume volume-1d4e7424-f2f2-4629-ad01-7f762898887d (1d4e7424-f2f2-4629-ad01-7f762898887d): created successfully Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc48bea-db29-4567-8999-aac1c138dda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:12 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Flow 'volume_create_manager' (1fbc58b6-7c6c-46e5-8f0e-9d7bc3857b43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:55:12 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-4f7b046c-ff25-41e9-a681-fa88f2aa9ebe tempest-AttachVolumeTestJSON-743042902 None] Created volume successfully. Nov 04 18:55:13 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11 1073741824" returned: 0 in 1.159s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:13 devstack sudo[96637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11 Nov 04 18:55:13 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:14 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11" returned: 0 in 0.640s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] <== create_volume: return (1924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:55:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.945s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb3d625-c82c-449e-940b-dcbef2032653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4294222d-813f-41a2-9533-76a9294859af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:14 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Volume volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11 (903b7a66-b6c3-47b6-ab10-1be6a2742a11): created successfully Nov 04 18:55:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4294222d-813f-41a2-9533-76a9294859af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Flow 'volume_create_manager' (7ce71d86-04c3-41fc-9005-410bde9d9997) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:55:14 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-5053c7fb-f757-4b37-8e7d-28fb4f1a4d65 tempest-VolumesSnapshotTestJSON-1967794390 None] Created volume successfully. Nov 04 18:55:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-877285d0-51a7-4068-ad97-1d8ea1245c45 req-f4a6c102-a3d3-4832-a41a-a762b1d2b22f tempest-AttachVolumeTestJSON-743042902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-877285d0-51a7-4068-ad97-1d8ea1245c45 req-f4a6c102-a3d3-4832-a41a-a762b1d2b22f tempest-AttachVolumeTestJSON-743042902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-877285d0-51a7-4068-ad97-1d8ea1245c45 req-f4a6c102-a3d3-4832-a41a-a762b1d2b22f tempest-AttachVolumeTestJSON-743042902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-877285d0-51a7-4068-ad97-1d8ea1245c45 req-f4a6c102-a3d3-4832-a41a-a762b1d2b22f tempest-AttachVolumeTestJSON-743042902 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280', 'name': 'volume-1d4e7424-f2f2-4629-ad01-7f762898887d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f2554cab-5682-40f2-af2e-fc9a5ad81902', 'enforce_multipath': True} {{(pid=87119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:55:14 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-877285d0-51a7-4068-ad97-1d8ea1245c45 req-f4a6c102-a3d3-4832-a41a-a762b1d2b22f tempest-AttachVolumeTestJSON-743042902 None] attachment_update completed successfully. Nov 04 18:55:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c609d958-ef63-4738-9862-c683cdab4011 tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c609d958-ef63-4738-9862-c683cdab4011 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:15 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-c609d958-ef63-4738-9862-c683cdab4011 tempest-VolumesSnapshotTestJSON-1967794390 None] Creating offline snapshot efb75b9d-7edf-4a56-86b3-ee780c6cbcec of volume 903b7a66-b6c3-47b6-ab10-1be6a2742a11 {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:55:15 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde83638-6929-467e-84b2-0c781257dd25]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c609d958-ef63-4738-9862-c683cdab4011 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:15 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11 Nov 04 18:55:15 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:16 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c609d958-ef63-4738-9862-c683cdab4011 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11" returned: 0 in 0.722s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c609d958-ef63-4738-9862-c683cdab4011 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.efb75b9d-7edf-4a56-86b3-ee780c6cbcec 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:16 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.efb75b9d-7edf-4a56-86b3-ee780c6cbcec 1G Nov 04 18:55:16 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:16 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-bd4b3663-022a-4372-9d95-b7e7871bea95 tempest-VolumesActionsTest-1747258751 None] Acquiring lock "cinder-13c504c7-2402-44c6-a086-d673b18ee667" by "attach_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:16 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-bd4b3663-022a-4372-9d95-b7e7871bea95 tempest-VolumesActionsTest-1747258751 None] Lock "cinder-13c504c7-2402-44c6-a086-d673b18ee667" acquired by "attach_volume" :: waited 0.093s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:16 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-bd4b3663-022a-4372-9d95-b7e7871bea95 tempest-VolumesActionsTest-1747258751 None] Attaching volume 13c504c7-2402-44c6-a086-d673b18ee667 to instance f7bbf920-21e9-434e-a9ab-84cb0ebebbc5 at mountpoint /dev/vdb on host None. Nov 04 18:55:16 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-bd4b3663-022a-4372-9d95-b7e7871bea95 tempest-VolumesActionsTest-1747258751 None] Attach volume completed successfully. Nov 04 18:55:16 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-bd4b3663-022a-4372-9d95-b7e7871bea95 tempest-VolumesActionsTest-1747258751 None] Lock "cinder-13c504c7-2402-44c6-a086-d673b18ee667" released by "attach_volume" :: held 0.233s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:17 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c609d958-ef63-4738-9862-c683cdab4011 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.efb75b9d-7edf-4a56-86b3-ee780c6cbcec 1G" returned: 0 in 0.783s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c609d958-ef63-4738-9862-c683cdab4011 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.efb75b9d-7edf-4a56-86b3-ee780c6cbcec {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:17 devstack sudo[96670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.efb75b9d-7edf-4a56-86b3-ee780c6cbcec Nov 04 18:55:17 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:17 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7e964855-7743-4de7-826b-d66b343a1c23 tempest-VolumesActionsTest-1747258751 None] Acquiring lock "cinder-13c504c7-2402-44c6-a086-d673b18ee667-detach_volume" by "detach_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:17 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7e964855-7743-4de7-826b-d66b343a1c23 tempest-VolumesActionsTest-1747258751 None] Lock "cinder-13c504c7-2402-44c6-a086-d673b18ee667-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:17 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-7e964855-7743-4de7-826b-d66b343a1c23 tempest-VolumesActionsTest-1747258751 None] Detaching volume 13c504c7-2402-44c6-a086-d673b18ee667 from instance f7bbf920-21e9-434e-a9ab-84cb0ebebbc5. Nov 04 18:55:17 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-7e964855-7743-4de7-826b-d66b343a1c23 tempest-VolumesActionsTest-1747258751 None] Detach volume completed successfully. Nov 04 18:55:17 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7e964855-7743-4de7-826b-d66b343a1c23 tempest-VolumesActionsTest-1747258751 None] Lock "cinder-13c504c7-2402-44c6-a086-d673b18ee667-detach_volume" released by "detach_volume" :: held 0.153s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:17 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c609d958-ef63-4738-9862-c683cdab4011 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.efb75b9d-7edf-4a56-86b3-ee780c6cbcec" returned: 0 in 0.513s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:17 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-c609d958-ef63-4738-9862-c683cdab4011 tempest-VolumesSnapshotTestJSON-1967794390 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.efb75b9d-7edf-4a56-86b3-ee780c6cbcec is being set with open permissions: ugo+rw Nov 04 18:55:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c609d958-ef63-4738-9862-c683cdab4011 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.efb75b9d-7edf-4a56-86b3-ee780c6cbcec {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:17 devstack sudo[96676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.efb75b9d-7edf-4a56-86b3-ee780c6cbcec Nov 04 18:55:17 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:18 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c609d958-ef63-4738-9862-c683cdab4011 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.efb75b9d-7edf-4a56-86b3-ee780c6cbcec" returned: 0 in 0.450s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:18 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-95c0013b-2e84-4ce4-a3f6-ab87480c3e18 req-e9369db6-ee57-48b6-a493-793e0868056d tempest-AttachVolumeTestJSON-743042902 None] Terminate volume connection completed successfully. Nov 04 18:55:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-95c0013b-2e84-4ce4-a3f6-ab87480c3e18 req-e9369db6-ee57-48b6-a493-793e0868056d tempest-AttachVolumeTestJSON-743042902 None] Deleting attachment 78a01723-2fb5-4ba9-8c41-40fffb10449e. {{(pid=87119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:55:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c609d958-ef63-4738-9862-c683cdab4011 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:18 devstack sudo[96687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.info Nov 04 18:55:18 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:18 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c609d958-ef63-4738-9862-c683cdab4011 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.info" returned: 0 in 0.442s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:18 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-c609d958-ef63-4738-9862-c683cdab4011 tempest-VolumesSnapshotTestJSON-1967794390 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.info is being set with open permissions: ugo+rw Nov 04 18:55:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c609d958-ef63-4738-9862-c683cdab4011 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:18 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.info Nov 04 18:55:18 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:18 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c609d958-ef63-4738-9862-c683cdab4011 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.info" returned: 0 in 0.370s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c609d958-ef63-4738-9862-c683cdab4011 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.449s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:19 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-c609d958-ef63-4738-9862-c683cdab4011 tempest-VolumesSnapshotTestJSON-1967794390 None] Create snapshot completed successfully Nov 04 18:55:19 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-394baff1-ea27-4650-8310-b2454e11f3df req-30d33efa-0e14-4f2a-9e76-e4af74c86f25 tempest-AttachVolumeTestJSON-743042902 None] Terminate volume connection completed successfully. Nov 04 18:55:19 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-394baff1-ea27-4650-8310-b2454e11f3df req-30d33efa-0e14-4f2a-9e76-e4af74c86f25 tempest-AttachVolumeTestJSON-743042902 None] Deleting attachment f2554cab-5682-40f2-af2e-fc9a5ad81902. {{(pid=87119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Flow 'volume_create_manager' (0c68a621-765d-49c5-b439-9a29cd275dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea3171f7-0cad-4bfa-856f-3bf0ef898fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea3171f7-0cad-4bfa-856f-3bf0ef898fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-573530586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c8a8ae-e1ee-4705-93ee-d7b0b207eba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be56dc86c6134d62a0bb36ba25256942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=efb75b9d-7edf-4a56-86b3-ee780c6cbcec,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:55:20Z,use_quota=True,user_id='90e16370f5334c04a94205df5adddde2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5573369e-88e7-4410-a0ad-ab8e8fb90c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5573369e-88e7-4410-a0ad-ab8e8fb90c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6a37548-3da8-4011-9c4b-b4c210dc7347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6a37548-3da8-4011-9c4b-b4c210dc7347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '75c8a8ae-e1ee-4705-93ee-d7b0b207eba1', 'volume_name': 'volume-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1', 'volume_size': 1, 'snapshot_id': 'efb75b9d-7edf-4a56-86b3-ee780c6cbcec'}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe6ac361-0913-42a5-9a82-ca8e37b41426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe6ac361-0913-42a5-9a82-ca8e37b41426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4641f8f8-110d-4c11-82b8-ffb0c8ece29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:20 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Volume 75c8a8ae-e1ee-4705-93ee-d7b0b207eba1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1', 'volume_size': 1, 'snapshot_id': 'efb75b9d-7edf-4a56-86b3-ee780c6cbcec'} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "cinder-quobyte-efb75b9d-7edf-4a56-86b3-ee780c6cbcec-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1" by "_create_volume_from_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-efb75b9d-7edf-4a56-86b3-ee780c6cbcec-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Creating volume 75c8a8ae-e1ee-4705-93ee-d7b0b207eba1 from snapshot efb75b9d-7edf-4a56-86b3-ee780c6cbcec {{(pid=87119) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "cinder-quobyte-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1" by "_copy_volume_from_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] snapshot: efb75b9d-7edf-4a56-86b3-ee780c6cbcec, volume: 75c8a8ae-e1ee-4705-93ee-d7b0b207eba1, {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b26f86c-37d3-41e5-bec9-eb9b36eeec61]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.efb75b9d-7edf-4a56-86b3-ee780c6cbcec {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:20 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.efb75b9d-7edf-4a56-86b3-ee780c6cbcec Nov 04 18:55:20 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:21 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.efb75b9d-7edf-4a56-86b3-ee780c6cbcec" returned: 0 in 0.481s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:21 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:55:21 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1714949-7f16-4f34-9296-597aa5dfea35]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:21 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11 Nov 04 18:55:21 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:21 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11" returned: 0 in 0.687s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:21 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11 {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 18:55:21 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Creating direct copy from snapshot {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 18:55:21 devstack cinder-volume[87119]: DEBUG cinder.utils [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Path /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1 not found in is_blk_device check {{(pid=87119) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 18:55:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:21 devstack sudo[96775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1 Nov 04 18:55:21 devstack sudo[96775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:55:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:25 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:55:25 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:26 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.745s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:26 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:55:26 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager._thread_info {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:55:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread count: 28 {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:55:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread info: [<_MainThread(MainThread, started 130247852032128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:55:30 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=87,cinder:INSERT=24,cinder:UPDATE=90,cinder:DELETE=7 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:55:30 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=90,cinder:INSERT=13,cinder:UPDATE=67,cinder:DELETE=8 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:55:32 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-507a1bc5-3e15-4573-bd2b-7622899645c4 tempest-AttachVolumeTestJSON-743042902 None] Acquiring lock "cinder-1d4e7424-f2f2-4629-ad01-7f762898887d-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:32 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-507a1bc5-3e15-4573-bd2b-7622899645c4 tempest-AttachVolumeTestJSON-743042902 None] Lock "cinder-1d4e7424-f2f2-4629-ad01-7f762898887d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:32 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-507a1bc5-3e15-4573-bd2b-7622899645c4 tempest-AttachVolumeTestJSON-743042902 None] Acquiring lock "cinder-quobyte-1d4e7424-f2f2-4629-ad01-7f762898887d" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:32 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-507a1bc5-3e15-4573-bd2b-7622899645c4 tempest-AttachVolumeTestJSON-743042902 None] Lock "cinder-quobyte-1d4e7424-f2f2-4629-ad01-7f762898887d" acquired by "delete_volume" :: waited 0.037s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:32 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54ea10a-3bfa-4627-a573-90df4e11b846]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-507a1bc5-3e15-4573-bd2b-7622899645c4 tempest-AttachVolumeTestJSON-743042902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d4e7424-f2f2-4629-ad01-7f762898887d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:32 devstack sudo[96775]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1" returned: 0 in 10.938s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:32 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Image conversion details: src /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11, size 1024.00 MB, duration 10.94 sec, destination /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1 {{(pid=87119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 18:55:32 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Converted 1024.00 MB image at 93.59 MB/s Nov 04 18:55:32 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1 is being set with open permissions: ugo+rw Nov 04 18:55:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:32 devstack sudo[96904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1 Nov 04 18:55:32 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:33 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d4e7424-f2f2-4629-ad01-7f762898887d Nov 04 18:55:33 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:33 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1" returned: 0 in 0.404s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:33 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1" released by "_copy_volume_from_snapshot" :: held 12.691s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:33 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-efb75b9d-7edf-4a56-86b3-ee780c6cbcec-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1" released by "_create_volume_from_snapshot" :: held 12.916s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.949s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4641f8f8-110d-4c11-82b8-ffb0c8ece29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1', 'volume_size': 1, 'snapshot_id': 'efb75b9d-7edf-4a56-86b3-ee780c6cbcec'}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d8c39bd-3484-4f86-80d3-c3c043f84e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:33 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Volume volume-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1 (75c8a8ae-e1ee-4705-93ee-d7b0b207eba1): created successfully Nov 04 18:55:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d8c39bd-3484-4f86-80d3-c3c043f84e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:33 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Flow 'volume_create_manager' (0c68a621-765d-49c5-b439-9a29cd275dca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:55:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-507a1bc5-3e15-4573-bd2b-7622899645c4 tempest-AttachVolumeTestJSON-743042902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d4e7424-f2f2-4629-ad01-7f762898887d" returned: 0 in 0.853s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-507a1bc5-3e15-4573-bd2b-7622899645c4 tempest-AttachVolumeTestJSON-743042902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d4e7424-f2f2-4629-ad01-7f762898887d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:33 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d4e7424-f2f2-4629-ad01-7f762898887d Nov 04 18:55:33 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-67df6acc-f456-42e6-9895-5b9257f917ac tempest-VolumesSnapshotTestJSON-1967794390 None] Created volume successfully. Nov 04 18:55:33 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:34 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-507a1bc5-3e15-4573-bd2b-7622899645c4 tempest-AttachVolumeTestJSON-743042902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d4e7424-f2f2-4629-ad01-7f762898887d" returned: 0 in 0.619s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:34 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c66d3dd5-0f85-4190-a7b5-8151c762db01 tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "cinder-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:34 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-507a1bc5-3e15-4573-bd2b-7622899645c4 tempest-AttachVolumeTestJSON-743042902 None] Lock "cinder-quobyte-1d4e7424-f2f2-4629-ad01-7f762898887d" released by "delete_volume" :: held 1.642s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:34 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c66d3dd5-0f85-4190-a7b5-8151c762db01 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:34 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c66d3dd5-0f85-4190-a7b5-8151c762db01 tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "cinder-quobyte-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:34 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c66d3dd5-0f85-4190-a7b5-8151c762db01 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1" acquired by "delete_volume" :: waited 0.043s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:34 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-507a1bc5-3e15-4573-bd2b-7622899645c4 tempest-AttachVolumeTestJSON-743042902 None] Created reservations ['d70bfcfb-211c-402a-9573-e2539cfd83d6', 'b368ba61-fa2b-4f74-aef3-c5840d076ed2', '52d66e50-6428-4118-bccd-d3cfaf5a1719', '8047f17c-750d-429f-9700-9cfb89b30475'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:55:34 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cc187a-0600-4157-81d5-70564e8191f5]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c66d3dd5-0f85-4190-a7b5-8151c762db01 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-507a1bc5-3e15-4573-bd2b-7622899645c4 tempest-AttachVolumeTestJSON-743042902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-507a1bc5-3e15-4573-bd2b-7622899645c4 tempest-AttachVolumeTestJSON-743042902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-507a1bc5-3e15-4573-bd2b-7622899645c4 tempest-AttachVolumeTestJSON-743042902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:34 devstack sudo[96973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1 Nov 04 18:55:34 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-507a1bc5-3e15-4573-bd2b-7622899645c4 tempest-AttachVolumeTestJSON-743042902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-507a1bc5-3e15-4573-bd2b-7622899645c4 tempest-AttachVolumeTestJSON-743042902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-507a1bc5-3e15-4573-bd2b-7622899645c4 tempest-AttachVolumeTestJSON-743042902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:35 devstack sudo[96983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:55:35 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:35 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-78aff568-ef40-4edc-8e55-7089ec6e190c tempest-AttachVolumeTestJSON-743042902 None] Acquiring lock "cinder-f38801f1-69a1-4509-b7dd-cf92cb2fd3bb-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:35 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-78aff568-ef40-4edc-8e55-7089ec6e190c tempest-AttachVolumeTestJSON-743042902 None] Lock "cinder-f38801f1-69a1-4509-b7dd-cf92cb2fd3bb-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:35 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-78aff568-ef40-4edc-8e55-7089ec6e190c tempest-AttachVolumeTestJSON-743042902 None] Acquiring lock "cinder-quobyte-f38801f1-69a1-4509-b7dd-cf92cb2fd3bb" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:35 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-78aff568-ef40-4edc-8e55-7089ec6e190c tempest-AttachVolumeTestJSON-743042902 None] Lock "cinder-quobyte-f38801f1-69a1-4509-b7dd-cf92cb2fd3bb" acquired by "delete_volume" :: waited 0.029s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:35 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c66d3dd5-0f85-4190-a7b5-8151c762db01 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1" returned: 0 in 1.048s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c66d3dd5-0f85-4190-a7b5-8151c762db01 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:35 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d957ad43-cd43-4fc2-90ec-e592e32743a1]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-78aff568-ef40-4edc-8e55-7089ec6e190c tempest-AttachVolumeTestJSON-743042902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f38801f1-69a1-4509-b7dd-cf92cb2fd3bb {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:35 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:35 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1 Nov 04 18:55:35 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-507a1bc5-3e15-4573-bd2b-7622899645c4 tempest-AttachVolumeTestJSON-743042902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.757s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:35 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-507a1bc5-3e15-4573-bd2b-7622899645c4 tempest-AttachVolumeTestJSON-743042902 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:55:35 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-507a1bc5-3e15-4573-bd2b-7622899645c4 tempest-AttachVolumeTestJSON-743042902 None] Deleted volume successfully. Nov 04 18:55:35 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-507a1bc5-3e15-4573-bd2b-7622899645c4 tempest-AttachVolumeTestJSON-743042902 None] Lock "cinder-1d4e7424-f2f2-4629-ad01-7f762898887d-delete_volume" released by "delete_volume" :: held 3.225s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:35 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f38801f1-69a1-4509-b7dd-cf92cb2fd3bb Nov 04 18:55:35 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:36 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-78aff568-ef40-4edc-8e55-7089ec6e190c tempest-AttachVolumeTestJSON-743042902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f38801f1-69a1-4509-b7dd-cf92cb2fd3bb" returned: 0 in 0.617s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-78aff568-ef40-4edc-8e55-7089ec6e190c tempest-AttachVolumeTestJSON-743042902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f38801f1-69a1-4509-b7dd-cf92cb2fd3bb {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:36 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f38801f1-69a1-4509-b7dd-cf92cb2fd3bb Nov 04 18:55:36 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:36 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c66d3dd5-0f85-4190-a7b5-8151c762db01 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1" returned: 0 in 1.130s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:36 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c66d3dd5-0f85-4190-a7b5-8151c762db01 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1" released by "delete_volume" :: held 2.350s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:36 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:55:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Flow 'volume_create_manager' (0a5294e2-1eae-433b-8a56-4c6f19ab3e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:55:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a31d52f-5e5d-496b-a11d-aa73fd05968a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:36 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-78aff568-ef40-4edc-8e55-7089ec6e190c tempest-AttachVolumeTestJSON-743042902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f38801f1-69a1-4509-b7dd-cf92cb2fd3bb" returned: 0 in 0.613s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a31d52f-5e5d-496b-a11d-aa73fd05968a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1141698768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bcfa821-ba10-4ac7-8565-dd80b77220c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8715a1993ff54d2bb90c2f858599db4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:55:37Z,use_quota=True,user_id='0bceb04d134e40dfab30dd39bf446259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b62237-2353-42db-8426-9a1e0eaf036b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b62237-2353-42db-8426-9a1e0eaf036b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e2bf41-02e4-4892-9461-4805e6dcb28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e2bf41-02e4-4892-9461-4805e6dcb28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bcfa821-ba10-4ac7-8565-dd80b77220c9', 'volume_name': 'volume-8bcfa821-ba10-4ac7-8565-dd80b77220c9', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0af5569-218e-4a97-92eb-35a83c68ac15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0af5569-218e-4a97-92eb-35a83c68ac15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389015c6-e287-471f-8add-6b36462f8903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:37 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Volume 8bcfa821-ba10-4ac7-8565-dd80b77220c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bcfa821-ba10-4ac7-8565-dd80b77220c9', 'volume_size': 1} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1141698768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bcfa821-ba10-4ac7-8565-dd80b77220c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8715a1993ff54d2bb90c2f858599db4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:55:37Z,use_quota=True,user_id='0bceb04d134e40dfab30dd39bf446259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Creating volume 8bcfa821-ba10-4ac7-8565-dd80b77220c9 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:55:37 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8bcfa821-ba10-4ac7-8565-dd80b77220c9 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-78aff568-ef40-4edc-8e55-7089ec6e190c tempest-AttachVolumeTestJSON-743042902 None] Lock "cinder-quobyte-f38801f1-69a1-4509-b7dd-cf92cb2fd3bb" released by "delete_volume" :: held 1.499s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:37 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8bcfa821-ba10-4ac7-8565-dd80b77220c9 1073741824 Nov 04 18:55:37 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-c66d3dd5-0f85-4190-a7b5-8151c762db01 tempest-VolumesSnapshotTestJSON-1967794390 None] Created reservations ['e97adfe1-2e44-4c00-b3f6-b09ba7133dcb', 'b072d411-fc40-45e6-95ed-b3f34443b55d', '625397ed-de0d-4f1a-a821-a36c755db59c', 'b9fa0940-6aac-4142-ae3d-498a2f339e00'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-78aff568-ef40-4edc-8e55-7089ec6e190c tempest-AttachVolumeTestJSON-743042902 None] Created reservations ['94137605-87ff-4d15-864e-4c5e916cf447', 'e68a8b65-b571-469c-afc9-041d779f7bcc', '521fc831-7cd4-4f83-981e-6a73d5569fca', 'e317fff5-0e76-45aa-a500-0a9d7cdb85bf'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c66d3dd5-0f85-4190-a7b5-8151c762db01 tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c66d3dd5-0f85-4190-a7b5-8151c762db01 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c66d3dd5-0f85-4190-a7b5-8151c762db01 tempest-VolumesSnapshotTestJSON-1967794390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c66d3dd5-0f85-4190-a7b5-8151c762db01 tempest-VolumesSnapshotTestJSON-1967794390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c66d3dd5-0f85-4190-a7b5-8151c762db01 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c66d3dd5-0f85-4190-a7b5-8151c762db01 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:37 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:55:37 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-78aff568-ef40-4edc-8e55-7089ec6e190c tempest-AttachVolumeTestJSON-743042902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-78aff568-ef40-4edc-8e55-7089ec6e190c tempest-AttachVolumeTestJSON-743042902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-78aff568-ef40-4edc-8e55-7089ec6e190c tempest-AttachVolumeTestJSON-743042902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-78aff568-ef40-4edc-8e55-7089ec6e190c tempest-AttachVolumeTestJSON-743042902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-78aff568-ef40-4edc-8e55-7089ec6e190c tempest-AttachVolumeTestJSON-743042902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-78aff568-ef40-4edc-8e55-7089ec6e190c tempest-AttachVolumeTestJSON-743042902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:37 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:55:37 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:37 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8bcfa821-ba10-4ac7-8565-dd80b77220c9 1073741824" returned: 0 in 0.766s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:37 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c66d3dd5-0f85-4190-a7b5-8151c762db01 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.536s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-c66d3dd5-0f85-4190-a7b5-8151c762db01 tempest-VolumesSnapshotTestJSON-1967794390 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:55:37 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-c66d3dd5-0f85-4190-a7b5-8151c762db01 tempest-VolumesSnapshotTestJSON-1967794390 None] Deleted volume successfully. Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8bcfa821-ba10-4ac7-8565-dd80b77220c9 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:37 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c66d3dd5-0f85-4190-a7b5-8151c762db01 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-75c8a8ae-e1ee-4705-93ee-d7b0b207eba1-delete_volume" released by "delete_volume" :: held 3.571s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:37 devstack sudo[97022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8bcfa821-ba10-4ac7-8565-dd80b77220c9 Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-78aff568-ef40-4edc-8e55-7089ec6e190c tempest-AttachVolumeTestJSON-743042902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.545s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:37 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:37 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-78aff568-ef40-4edc-8e55-7089ec6e190c tempest-AttachVolumeTestJSON-743042902 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:55:37 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-78aff568-ef40-4edc-8e55-7089ec6e190c tempest-AttachVolumeTestJSON-743042902 None] Deleted volume successfully. Nov 04 18:55:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-78aff568-ef40-4edc-8e55-7089ec6e190c tempest-AttachVolumeTestJSON-743042902 None] Lock "cinder-f38801f1-69a1-4509-b7dd-cf92cb2fd3bb-delete_volume" released by "delete_volume" :: held 2.644s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-77dee584-9d68-4ae5-8f5e-6a28975927f8 tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "cinder-efb75b9d-7edf-4a56-86b3-ee780c6cbcec-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-77dee584-9d68-4ae5-8f5e-6a28975927f8 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-efb75b9d-7edf-4a56-86b3-ee780c6cbcec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-77dee584-9d68-4ae5-8f5e-6a28975927f8 tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "cinder-quobyte-903b7a66-b6c3-47b6-ab10-1be6a2742a11" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2f41c128-ab98-4a20-a30d-ee673cd21d14 tempest-AttachVolumeTestJSON-743042902 None] Acquiring lock "cinder-18a9b918-9479-49e2-917a-b36322723114-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-77dee584-9d68-4ae5-8f5e-6a28975927f8 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-903b7a66-b6c3-47b6-ab10-1be6a2742a11" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-77dee584-9d68-4ae5-8f5e-6a28975927f8 tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "cinder-quobyte-efb75b9d-7edf-4a56-86b3-ee780c6cbcec" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2f41c128-ab98-4a20-a30d-ee673cd21d14 tempest-AttachVolumeTestJSON-743042902 None] Lock "cinder-18a9b918-9479-49e2-917a-b36322723114-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-77dee584-9d68-4ae5-8f5e-6a28975927f8 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-efb75b9d-7edf-4a56-86b3-ee780c6cbcec" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-77dee584-9d68-4ae5-8f5e-6a28975927f8 tempest-VolumesSnapshotTestJSON-1967794390 None] Deleting offline snapshot efb75b9d-7edf-4a56-86b3-ee780c6cbcec of volume 903b7a66-b6c3-47b6-ab10-1be6a2742a11 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:55:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-77dee584-9d68-4ae5-8f5e-6a28975927f8 tempest-VolumesSnapshotTestJSON-1967794390 None] snapshot_file for this snap is: volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.efb75b9d-7edf-4a56-86b3-ee780c6cbcec {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:55:38 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f72a22-b988-4594-a8b7-95576a62e997]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-77dee584-9d68-4ae5-8f5e-6a28975927f8 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.efb75b9d-7edf-4a56-86b3-ee780c6cbcec {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:38 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2f41c128-ab98-4a20-a30d-ee673cd21d14 tempest-AttachVolumeTestJSON-743042902 None] Acquiring lock "cinder-quobyte-18a9b918-9479-49e2-917a-b36322723114" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8bcfa821-ba10-4ac7-8565-dd80b77220c9" returned: 0 in 0.772s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:55:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2f41c128-ab98-4a20-a30d-ee673cd21d14 tempest-AttachVolumeTestJSON-743042902 None] Lock "cinder-quobyte-18a9b918-9479-49e2-917a-b36322723114" acquired by "delete_volume" :: waited 0.065s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389015c6-e287-471f-8add-6b36462f8903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bcfa821-ba10-4ac7-8565-dd80b77220c9', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79cf8446-80eb-4aa3-a2e4-439deccc86bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:38 devstack sudo[97025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.efb75b9d-7edf-4a56-86b3-ee780c6cbcec Nov 04 18:55:38 devstack sudo[97025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:38 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4901eb9-2d33-4fa6-9030-bf56a39d19fb]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2f41c128-ab98-4a20-a30d-ee673cd21d14 tempest-AttachVolumeTestJSON-743042902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-18a9b918-9479-49e2-917a-b36322723114 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:38 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Volume volume-8bcfa821-ba10-4ac7-8565-dd80b77220c9 (8bcfa821-ba10-4ac7-8565-dd80b77220c9): created successfully Nov 04 18:55:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79cf8446-80eb-4aa3-a2e4-439deccc86bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Flow 'volume_create_manager' (0a5294e2-1eae-433b-8a56-4c6f19ab3e7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:55:39 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-1a0886bd-adad-4c61-9cd2-e5f6abdb2662 tempest-VolumesActionsTest-606381164 None] Created volume successfully. Nov 04 18:55:39 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6dddea8d-d89e-4891-b4e2-c6721e7ef183 tempest-VolumesActionsTest-1747258751 None] Acquiring lock "cinder-13c504c7-2402-44c6-a086-d673b18ee667" by "attach_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:39 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-18a9b918-9479-49e2-917a-b36322723114 Nov 04 18:55:39 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:39 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6dddea8d-d89e-4891-b4e2-c6721e7ef183 tempest-VolumesActionsTest-1747258751 None] Lock "cinder-13c504c7-2402-44c6-a086-d673b18ee667" acquired by "attach_volume" :: waited 0.032s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:39 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-6dddea8d-d89e-4891-b4e2-c6721e7ef183 tempest-VolumesActionsTest-1747258751 None] Attaching volume 13c504c7-2402-44c6-a086-d673b18ee667 to instance d870f6a2-9e9a-4b20-ad34-76d0eb7e73b6 at mountpoint /dev/vdb on host None. Nov 04 18:55:39 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-6dddea8d-d89e-4891-b4e2-c6721e7ef183 tempest-VolumesActionsTest-1747258751 None] Attach volume completed successfully. Nov 04 18:55:39 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6dddea8d-d89e-4891-b4e2-c6721e7ef183 tempest-VolumesActionsTest-1747258751 None] Lock "cinder-13c504c7-2402-44c6-a086-d673b18ee667" released by "attach_volume" :: held 0.185s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:39 devstack sudo[97025]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-77dee584-9d68-4ae5-8f5e-6a28975927f8 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.efb75b9d-7edf-4a56-86b3-ee780c6cbcec" returned: 0 in 1.058s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:39 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-77dee584-9d68-4ae5-8f5e-6a28975927f8 tempest-VolumesSnapshotTestJSON-1967794390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:55:39 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[1233e3bd-ff03-4ab2-a499-2dbbad160b7f]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-77dee584-9d68-4ae5-8f5e-6a28975927f8 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:39 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6afbf1d9-dec9-4028-bb91-54a0257e879d tempest-VolumesActionsTest-606381164 None] Acquiring lock "cinder-8bcfa821-ba10-4ac7-8565-dd80b77220c9" by "attach_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:39 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6afbf1d9-dec9-4028-bb91-54a0257e879d tempest-VolumesActionsTest-606381164 None] Lock "cinder-8bcfa821-ba10-4ac7-8565-dd80b77220c9" acquired by "attach_volume" :: waited 0.037s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:40 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2f41c128-ab98-4a20-a30d-ee673cd21d14 tempest-AttachVolumeTestJSON-743042902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-18a9b918-9479-49e2-917a-b36322723114" returned: 0 in 1.197s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2f41c128-ab98-4a20-a30d-ee673cd21d14 tempest-AttachVolumeTestJSON-743042902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-18a9b918-9479-49e2-917a-b36322723114 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:40 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-18a9b918-9479-49e2-917a-b36322723114 Nov 04 18:55:40 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:40 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11 Nov 04 18:55:40 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:40 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-6afbf1d9-dec9-4028-bb91-54a0257e879d tempest-VolumesActionsTest-606381164 None] Attaching volume 8bcfa821-ba10-4ac7-8565-dd80b77220c9 to instance c866bc81-101a-432d-b2ac-c8ee3849b0ba at mountpoint /dev/vdb on host None. Nov 04 18:55:40 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-6afbf1d9-dec9-4028-bb91-54a0257e879d tempest-VolumesActionsTest-606381164 None] Attach volume completed successfully. Nov 04 18:55:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6afbf1d9-dec9-4028-bb91-54a0257e879d tempest-VolumesActionsTest-606381164 None] Lock "cinder-8bcfa821-ba10-4ac7-8565-dd80b77220c9" released by "attach_volume" :: held 0.311s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b86f7089-44b2-40c4-9380-306bad907a20 tempest-VolumesActionsTest-1747258751 None] Acquiring lock "cinder-13c504c7-2402-44c6-a086-d673b18ee667-detach_volume" by "detach_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b86f7089-44b2-40c4-9380-306bad907a20 tempest-VolumesActionsTest-1747258751 None] Lock "cinder-13c504c7-2402-44c6-a086-d673b18ee667-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:40 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-b86f7089-44b2-40c4-9380-306bad907a20 tempest-VolumesActionsTest-1747258751 None] Detaching volume 13c504c7-2402-44c6-a086-d673b18ee667 from instance d870f6a2-9e9a-4b20-ad34-76d0eb7e73b6. Nov 04 18:55:40 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2f41c128-ab98-4a20-a30d-ee673cd21d14 tempest-AttachVolumeTestJSON-743042902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-18a9b918-9479-49e2-917a-b36322723114" returned: 0 in 0.859s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:41 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2f41c128-ab98-4a20-a30d-ee673cd21d14 tempest-AttachVolumeTestJSON-743042902 None] Lock "cinder-quobyte-18a9b918-9479-49e2-917a-b36322723114" released by "delete_volume" :: held 2.265s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:41 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-b86f7089-44b2-40c4-9380-306bad907a20 tempest-VolumesActionsTest-1747258751 None] Detach volume completed successfully. Nov 04 18:55:41 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b86f7089-44b2-40c4-9380-306bad907a20 tempest-VolumesActionsTest-1747258751 None] Lock "cinder-13c504c7-2402-44c6-a086-d673b18ee667-detach_volume" released by "detach_volume" :: held 0.369s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:41 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-77dee584-9d68-4ae5-8f5e-6a28975927f8 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11" returned: 0 in 1.469s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-77dee584-9d68-4ae5-8f5e-6a28975927f8 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.efb75b9d-7edf-4a56-86b3-ee780c6cbcec {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:41 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.efb75b9d-7edf-4a56-86b3-ee780c6cbcec Nov 04 18:55:41 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:41 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-2f41c128-ab98-4a20-a30d-ee673cd21d14 tempest-AttachVolumeTestJSON-743042902 None] Created reservations ['4fbd0064-0251-401f-a117-81f85ab688b8', '44d3f3ab-ca5a-4ce9-9f77-711d5e8d19cf', '2f03b0cd-37c5-48b6-8ec5-da27ffe94742', '82dc7f41-f9f1-44db-809d-0727eeba4da9'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:55:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2f41c128-ab98-4a20-a30d-ee673cd21d14 tempest-AttachVolumeTestJSON-743042902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2f41c128-ab98-4a20-a30d-ee673cd21d14 tempest-AttachVolumeTestJSON-743042902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:41 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2f41c128-ab98-4a20-a30d-ee673cd21d14 tempest-AttachVolumeTestJSON-743042902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:41 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2f41c128-ab98-4a20-a30d-ee673cd21d14 tempest-AttachVolumeTestJSON-743042902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2f41c128-ab98-4a20-a30d-ee673cd21d14 tempest-AttachVolumeTestJSON-743042902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.060s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2f41c128-ab98-4a20-a30d-ee673cd21d14 tempest-AttachVolumeTestJSON-743042902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:41 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:55:41 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:42 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-77dee584-9d68-4ae5-8f5e-6a28975927f8 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.efb75b9d-7edf-4a56-86b3-ee780c6cbcec" returned: 0 in 1.139s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-77dee584-9d68-4ae5-8f5e-6a28975927f8 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.efb75b9d-7edf-4a56-86b3-ee780c6cbcec {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:42 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.efb75b9d-7edf-4a56-86b3-ee780c6cbcec Nov 04 18:55:42 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:42 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-27938c07-6b26-4287-928d-1dcbadff695b tempest-VolumesActionsTest-672344341 None] Terminate volume connection completed successfully. Nov 04 18:55:42 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-27938c07-6b26-4287-928d-1dcbadff695b tempest-VolumesActionsTest-672344341 None] Acquiring lock "cinder-8bcfa821-ba10-4ac7-8565-dd80b77220c9-detach_volume" by "detach_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2f41c128-ab98-4a20-a30d-ee673cd21d14 tempest-AttachVolumeTestJSON-743042902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 1.045s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:42 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-2f41c128-ab98-4a20-a30d-ee673cd21d14 tempest-AttachVolumeTestJSON-743042902 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:55:42 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-2f41c128-ab98-4a20-a30d-ee673cd21d14 tempest-AttachVolumeTestJSON-743042902 None] Deleted volume successfully. Nov 04 18:55:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-27938c07-6b26-4287-928d-1dcbadff695b tempest-VolumesActionsTest-672344341 None] Lock "cinder-8bcfa821-ba10-4ac7-8565-dd80b77220c9-detach_volume" acquired by "detach_volume" :: waited 0.108s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:42 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-27938c07-6b26-4287-928d-1dcbadff695b tempest-VolumesActionsTest-672344341 None] Detaching volume 8bcfa821-ba10-4ac7-8565-dd80b77220c9 from instance c866bc81-101a-432d-b2ac-c8ee3849b0ba. Nov 04 18:55:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2f41c128-ab98-4a20-a30d-ee673cd21d14 tempest-AttachVolumeTestJSON-743042902 None] Lock "cinder-18a9b918-9479-49e2-917a-b36322723114-delete_volume" released by "delete_volume" :: held 4.455s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:42 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-77dee584-9d68-4ae5-8f5e-6a28975927f8 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11.efb75b9d-7edf-4a56-86b3-ee780c6cbcec" returned: 0 in 0.622s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-77dee584-9d68-4ae5-8f5e-6a28975927f8 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-efb75b9d-7edf-4a56-86b3-ee780c6cbcec" released by "_delete_snapshot" :: held 4.560s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-77dee584-9d68-4ae5-8f5e-6a28975927f8 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-903b7a66-b6c3-47b6-ab10-1be6a2742a11" released by "delete_snapshot" :: held 4.626s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:43 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-27938c07-6b26-4287-928d-1dcbadff695b tempest-VolumesActionsTest-672344341 None] Detach volume completed successfully. Nov 04 18:55:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-27938c07-6b26-4287-928d-1dcbadff695b tempest-VolumesActionsTest-672344341 None] Lock "cinder-8bcfa821-ba10-4ac7-8565-dd80b77220c9-detach_volume" released by "detach_volume" :: held 0.321s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:43 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-77dee584-9d68-4ae5-8f5e-6a28975927f8 tempest-VolumesSnapshotTestJSON-1967794390 None] Created reservations ['3dab958e-d846-43aa-ab5a-8584f0e9a4b0', 'ca580cbd-caea-48c9-a5fd-5d1d4faa6906', 'c8ffc603-0f90-4164-a758-16243d90ab41', '506b6a99-3926-4d9d-9025-923c782d76ba'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:55:43 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-77dee584-9d68-4ae5-8f5e-6a28975927f8 tempest-VolumesSnapshotTestJSON-1967794390 None] Delete snapshot completed successfully. Nov 04 18:55:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-77dee584-9d68-4ae5-8f5e-6a28975927f8 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-efb75b9d-7edf-4a56-86b3-ee780c6cbcec-delete_snapshot" released by "delete_snapshot" :: held 4.967s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-29e392c0-8e17-4a6a-9960-3ce81ed99316 tempest-VolumesActionsTest-606381164 None] Acquiring lock "cinder-8bcfa821-ba10-4ac7-8565-dd80b77220c9-detach_volume" by "detach_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-29e392c0-8e17-4a6a-9960-3ce81ed99316 tempest-VolumesActionsTest-606381164 None] Lock "cinder-8bcfa821-ba10-4ac7-8565-dd80b77220c9-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:43 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-29e392c0-8e17-4a6a-9960-3ce81ed99316 tempest-VolumesActionsTest-606381164 None] Volume detach called, but volume not attached. Nov 04 18:55:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-29e392c0-8e17-4a6a-9960-3ce81ed99316 tempest-VolumesActionsTest-606381164 None] Lock "cinder-8bcfa821-ba10-4ac7-8565-dd80b77220c9-detach_volume" released by "detach_volume" :: held 0.036s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-778e8ec5-064a-4788-afce-6aba3a6aaa47 tempest-VolumesActionsTest-606381164 None] Acquiring lock "cinder-8bcfa821-ba10-4ac7-8565-dd80b77220c9-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-778e8ec5-064a-4788-afce-6aba3a6aaa47 tempest-VolumesActionsTest-606381164 None] Lock "cinder-8bcfa821-ba10-4ac7-8565-dd80b77220c9-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-778e8ec5-064a-4788-afce-6aba3a6aaa47 tempest-VolumesActionsTest-606381164 None] Acquiring lock "cinder-quobyte-8bcfa821-ba10-4ac7-8565-dd80b77220c9" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-778e8ec5-064a-4788-afce-6aba3a6aaa47 tempest-VolumesActionsTest-606381164 None] Lock "cinder-quobyte-8bcfa821-ba10-4ac7-8565-dd80b77220c9" acquired by "delete_volume" :: waited 0.030s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:44 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f07648d-16bc-4ddd-9b1a-f598783895a0]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-778e8ec5-064a-4788-afce-6aba3a6aaa47 tempest-VolumesActionsTest-606381164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8bcfa821-ba10-4ac7-8565-dd80b77220c9 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2d6a3ccd-8a96-461c-8661-0f6cdce4d22e tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "cinder-903b7a66-b6c3-47b6-ab10-1be6a2742a11-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2d6a3ccd-8a96-461c-8661-0f6cdce4d22e tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-903b7a66-b6c3-47b6-ab10-1be6a2742a11-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2d6a3ccd-8a96-461c-8661-0f6cdce4d22e tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "cinder-quobyte-903b7a66-b6c3-47b6-ab10-1be6a2742a11" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2d6a3ccd-8a96-461c-8661-0f6cdce4d22e tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-903b7a66-b6c3-47b6-ab10-1be6a2742a11" acquired by "delete_volume" :: waited 0.026s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:44 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8bcfa821-ba10-4ac7-8565-dd80b77220c9 Nov 04 18:55:44 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:44 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc8eb60-44b2-4154-a58d-5a6d15a7dbf4]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2d6a3ccd-8a96-461c-8661-0f6cdce4d22e tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:44 devstack sudo[97096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11 Nov 04 18:55:44 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:44 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-778e8ec5-064a-4788-afce-6aba3a6aaa47 tempest-VolumesActionsTest-606381164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8bcfa821-ba10-4ac7-8565-dd80b77220c9" returned: 0 in 0.764s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-778e8ec5-064a-4788-afce-6aba3a6aaa47 tempest-VolumesActionsTest-606381164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8bcfa821-ba10-4ac7-8565-dd80b77220c9 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:45 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8bcfa821-ba10-4ac7-8565-dd80b77220c9 Nov 04 18:55:45 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:45 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2d6a3ccd-8a96-461c-8661-0f6cdce4d22e tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11" returned: 0 in 0.795s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2d6a3ccd-8a96-461c-8661-0f6cdce4d22e tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:45 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11 Nov 04 18:55:45 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:45 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-778e8ec5-064a-4788-afce-6aba3a6aaa47 tempest-VolumesActionsTest-606381164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8bcfa821-ba10-4ac7-8565-dd80b77220c9" returned: 0 in 0.500s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-778e8ec5-064a-4788-afce-6aba3a6aaa47 tempest-VolumesActionsTest-606381164 None] Lock "cinder-quobyte-8bcfa821-ba10-4ac7-8565-dd80b77220c9" released by "delete_volume" :: held 1.345s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:45 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-778e8ec5-064a-4788-afce-6aba3a6aaa47 tempest-VolumesActionsTest-606381164 None] Created reservations ['68ad5519-19d0-4910-991d-18b5e1160a13', '758d7f14-25a4-4490-b051-7c647c3ba8f4', 'd7fd2bcc-055a-4c82-90c4-246c5b042a6b', 'e0933792-66af-4d1e-b0d1-ff67f2451334'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:55:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-778e8ec5-064a-4788-afce-6aba3a6aaa47 tempest-VolumesActionsTest-606381164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-778e8ec5-064a-4788-afce-6aba3a6aaa47 tempest-VolumesActionsTest-606381164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-778e8ec5-064a-4788-afce-6aba3a6aaa47 tempest-VolumesActionsTest-606381164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:45 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-778e8ec5-064a-4788-afce-6aba3a6aaa47 tempest-VolumesActionsTest-606381164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-778e8ec5-064a-4788-afce-6aba3a6aaa47 tempest-VolumesActionsTest-606381164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-778e8ec5-064a-4788-afce-6aba3a6aaa47 tempest-VolumesActionsTest-606381164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2d6a3ccd-8a96-461c-8661-0f6cdce4d22e tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-903b7a66-b6c3-47b6-ab10-1be6a2742a11" returned: 0 in 0.456s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2d6a3ccd-8a96-461c-8661-0f6cdce4d22e tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-903b7a66-b6c3-47b6-ab10-1be6a2742a11" released by "delete_volume" :: held 1.393s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:45 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:55:45 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:45 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-2d6a3ccd-8a96-461c-8661-0f6cdce4d22e tempest-VolumesSnapshotTestJSON-1967794390 None] Created reservations ['f2422623-89ee-48bd-ad07-de7c777fc0d3', '9e37760f-5ad9-445d-ae6e-f8da912ffa74', '1929188b-b679-4502-9179-9b6c0512c4ea', '849170d4-6634-4a75-af55-11cc3680b73e'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:55:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2d6a3ccd-8a96-461c-8661-0f6cdce4d22e tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2d6a3ccd-8a96-461c-8661-0f6cdce4d22e tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2d6a3ccd-8a96-461c-8661-0f6cdce4d22e tempest-VolumesSnapshotTestJSON-1967794390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2d6a3ccd-8a96-461c-8661-0f6cdce4d22e tempest-VolumesSnapshotTestJSON-1967794390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2d6a3ccd-8a96-461c-8661-0f6cdce4d22e tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2d6a3ccd-8a96-461c-8661-0f6cdce4d22e tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:46 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-778e8ec5-064a-4788-afce-6aba3a6aaa47 tempest-VolumesActionsTest-606381164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.337s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:46 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-778e8ec5-064a-4788-afce-6aba3a6aaa47 tempest-VolumesActionsTest-606381164 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:55:46 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-778e8ec5-064a-4788-afce-6aba3a6aaa47 tempest-VolumesActionsTest-606381164 None] Deleted volume successfully. Nov 04 18:55:46 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:55:46 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-778e8ec5-064a-4788-afce-6aba3a6aaa47 tempest-VolumesActionsTest-606381164 None] Lock "cinder-8bcfa821-ba10-4ac7-8565-dd80b77220c9-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:46 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2d6a3ccd-8a96-461c-8661-0f6cdce4d22e tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.312s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:46 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-2d6a3ccd-8a96-461c-8661-0f6cdce4d22e tempest-VolumesSnapshotTestJSON-1967794390 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:55:46 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-2d6a3ccd-8a96-461c-8661-0f6cdce4d22e tempest-VolumesSnapshotTestJSON-1967794390 None] Deleted volume successfully. Nov 04 18:55:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2d6a3ccd-8a96-461c-8661-0f6cdce4d22e tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-903b7a66-b6c3-47b6-ab10-1be6a2742a11-delete_volume" released by "delete_volume" :: held 2.175s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a03061d1-27a5-49ea-95ae-ad17f296d3b3 tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "cinder-12b357eb-b5a6-4a70-a275-c779c810b88b-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a03061d1-27a5-49ea-95ae-ad17f296d3b3 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-12b357eb-b5a6-4a70-a275-c779c810b88b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a03061d1-27a5-49ea-95ae-ad17f296d3b3 tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "cinder-quobyte-12b357eb-b5a6-4a70-a275-c779c810b88b" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a03061d1-27a5-49ea-95ae-ad17f296d3b3 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-12b357eb-b5a6-4a70-a275-c779c810b88b" acquired by "delete_volume" :: waited 0.035s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:46 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8adfab-591f-4935-b245-761afc27216b]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a03061d1-27a5-49ea-95ae-ad17f296d3b3 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:47 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b Nov 04 18:55:47 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:47 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a03061d1-27a5-49ea-95ae-ad17f296d3b3 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b" returned: 0 in 0.672s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a03061d1-27a5-49ea-95ae-ad17f296d3b3 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:47 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b Nov 04 18:55:47 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:47 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a03061d1-27a5-49ea-95ae-ad17f296d3b3 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b357eb-b5a6-4a70-a275-c779c810b88b" returned: 0 in 0.303s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:47 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a03061d1-27a5-49ea-95ae-ad17f296d3b3 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-quobyte-12b357eb-b5a6-4a70-a275-c779c810b88b" released by "delete_volume" :: held 1.094s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:47 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-a03061d1-27a5-49ea-95ae-ad17f296d3b3 tempest-VolumesSnapshotTestJSON-1967794390 None] Created reservations ['7c353960-74ac-49ca-902b-51d0aabcb4ca', '91909dd5-d6a1-4e9c-bf1f-70029420f746', '44c1c32f-eb82-4d92-aa46-5f8e2ebbd36c', '0cdc7cb8-84d2-4837-bbd0-7ba196585bef'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:55:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a03061d1-27a5-49ea-95ae-ad17f296d3b3 tempest-VolumesSnapshotTestJSON-1967794390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a03061d1-27a5-49ea-95ae-ad17f296d3b3 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a03061d1-27a5-49ea-95ae-ad17f296d3b3 tempest-VolumesSnapshotTestJSON-1967794390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a03061d1-27a5-49ea-95ae-ad17f296d3b3 tempest-VolumesSnapshotTestJSON-1967794390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a03061d1-27a5-49ea-95ae-ad17f296d3b3 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a03061d1-27a5-49ea-95ae-ad17f296d3b3 tempest-VolumesSnapshotTestJSON-1967794390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:48 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:55:48 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:48 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a03061d1-27a5-49ea-95ae-ad17f296d3b3 tempest-VolumesSnapshotTestJSON-1967794390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.296s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:48 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-a03061d1-27a5-49ea-95ae-ad17f296d3b3 tempest-VolumesSnapshotTestJSON-1967794390 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:55:48 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-a03061d1-27a5-49ea-95ae-ad17f296d3b3 tempest-VolumesSnapshotTestJSON-1967794390 None] Deleted volume successfully. Nov 04 18:55:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a03061d1-27a5-49ea-95ae-ad17f296d3b3 tempest-VolumesSnapshotTestJSON-1967794390 None] Lock "cinder-12b357eb-b5a6-4a70-a275-c779c810b88b-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b8029bc7-3041-411a-9fd7-90d8ade609fe tempest-VolumesActionsTest-1747258751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b8029bc7-3041-411a-9fd7-90d8ade609fe tempest-VolumesActionsTest-1747258751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:48 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[12876742-2a44-4c5e-b1d0-7b6af81f052a]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b8029bc7-3041-411a-9fd7-90d8ade609fe tempest-VolumesActionsTest-1747258751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:49 devstack sudo[97204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667 Nov 04 18:55:49 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:49 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b8029bc7-3041-411a-9fd7-90d8ade609fe tempest-VolumesActionsTest-1747258751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667" returned: 0 in 0.393s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:49 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc12152-8f90-4c06-aa1c-296d5571fe18]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b8029bc7-3041-411a-9fd7-90d8ade609fe tempest-VolumesActionsTest-1747258751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:49 devstack sudo[97209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667 Nov 04 18:55:49 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:49 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b8029bc7-3041-411a-9fd7-90d8ade609fe tempest-VolumesActionsTest-1747258751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667" returned: 0 in 0.447s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b8029bc7-3041-411a-9fd7-90d8ade609fe tempest-VolumesActionsTest-1747258751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667 /opt/stack/data/cinder/conversion/13c504c7-2402-44c6-a086-d673b18ee667.temp_image.313189ac-4655-45dc-91e5-0495178a85e3ozftw0k5.img {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:49 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667 /opt/stack/data/cinder/conversion/13c504c7-2402-44c6-a086-d673b18ee667.temp_image.313189ac-4655-45dc-91e5-0495178a85e3ozftw0k5.img Nov 04 18:55:49 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:50 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:55:50 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Flow 'volume_create_manager' (60d4e4e1-52cb-46a6-a4f7-b222f6a3bfa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:55:50 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80a029f2-18f3-403a-b087-8849987c5a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:50 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80a029f2-18f3-403a-b087-8849987c5a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-251615696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd16fd8e-aa99-460b-9f75-bf515d3a0099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8715a1993ff54d2bb90c2f858599db4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:55:51Z,use_quota=True,user_id='0bceb04d134e40dfab30dd39bf446259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:50 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55c2793-28e3-4f19-a269-f8cee14c9e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:50 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55c2793-28e3-4f19-a269-f8cee14c9e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:50 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232179d0-2468-44b0-a0fc-fe6a618c0176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:50 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232179d0-2468-44b0-a0fc-fe6a618c0176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd16fd8e-aa99-460b-9f75-bf515d3a0099', 'volume_name': 'volume-dd16fd8e-aa99-460b-9f75-bf515d3a0099', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:51 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8003cf94-0b5d-476c-a15f-f3aba186de97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:51 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8003cf94-0b5d-476c-a15f-f3aba186de97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:51 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3650eed4-3692-40f0-8c9a-474ea07967cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:51 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Volume dd16fd8e-aa99-460b-9f75-bf515d3a0099: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd16fd8e-aa99-460b-9f75-bf515d3a0099', 'volume_size': 1} Nov 04 18:55:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:57 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b8029bc7-3041-411a-9fd7-90d8ade609fe tempest-VolumesActionsTest-1747258751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667 /opt/stack/data/cinder/conversion/13c504c7-2402-44c6-a086-d673b18ee667.temp_image.313189ac-4655-45dc-91e5-0495178a85e3ozftw0k5.img" returned: 0 in 7.794s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:57 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fec654-cc7b-4db1-b641-9663141c2e01]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b8029bc7-3041-411a-9fd7-90d8ade609fe tempest-VolumesActionsTest-1747258751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:57 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667 Nov 04 18:55:57 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:58 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b8029bc7-3041-411a-9fd7-90d8ade609fe tempest-VolumesActionsTest-1747258751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667" returned: 0 in 0.619s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:58 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-b8029bc7-3041-411a-9fd7-90d8ade609fe tempest-VolumesActionsTest-1747258751 None] Image conversion details: src /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667, size 1024.00 MB, duration 7.80 sec, destination /opt/stack/data/cinder/conversion/13c504c7-2402-44c6-a086-d673b18ee667.temp_image.313189ac-4655-45dc-91e5-0495178a85e3ozftw0k5.img {{(pid=87119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 18:55:58 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-b8029bc7-3041-411a-9fd7-90d8ade609fe tempest-VolumesActionsTest-1747258751 None] Converted 1024.00 MB image at 131.36 MB/s Nov 04 18:55:58 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-b8029bc7-3041-411a-9fd7-90d8ade609fe tempest-VolumesActionsTest-1747258751 None] 313189ac-4655-45dc-91e5-0495178a85e3 was raw, no need to convert to raw {{(pid=87119) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 04 18:56:00 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=68,cinder:UPDATE=74,cinder:INSERT=17,cinder:DELETE=1 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:56:08 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=53,cinder:UPDATE=74,cinder:DELETE=8,cinder:INSERT=21 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:56:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:56:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:56:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:56:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:25 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:56:25 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:25 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.342s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:25 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:56:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager._thread_info {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:56:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread count: 28 {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:56:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread info: [<_MainThread(MainThread, started 130247852032128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:56:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b8029bc7-3041-411a-9fd7-90d8ade609fe tempest-VolumesActionsTest-1747258751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 37.313s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b8029bc7-3041-411a-9fd7-90d8ade609fe tempest-VolumesActionsTest-1747258751 None] Uploaded volume to glance image-id: 313189ac-4655-45dc-91e5-0495178a85e3. {{(pid=87119) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 04 18:56:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 35.184s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-251615696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd16fd8e-aa99-460b-9f75-bf515d3a0099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8715a1993ff54d2bb90c2f858599db4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:55:51Z,use_quota=True,user_id='0bceb04d134e40dfab30dd39bf446259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:56:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Creating volume dd16fd8e-aa99-460b-9f75-bf515d3a0099 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:56:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:56:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:56:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:56:26 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:56:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dd16fd8e-aa99-460b-9f75-bf515d3a0099 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:26 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dd16fd8e-aa99-460b-9f75-bf515d3a0099 1073741824 Nov 04 18:56:26 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:26 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-b8029bc7-3041-411a-9fd7-90d8ade609fe tempest-VolumesActionsTest-1747258751 None] Copy volume to image completed successfully. Nov 04 18:56:26 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dd16fd8e-aa99-460b-9f75-bf515d3a0099 1073741824" returned: 0 in 0.547s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dd16fd8e-aa99-460b-9f75-bf515d3a0099 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:26 devstack sudo[97346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dd16fd8e-aa99-460b-9f75-bf515d3a0099 Nov 04 18:56:26 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:27 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dd16fd8e-aa99-460b-9f75-bf515d3a0099" returned: 0 in 0.313s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:27 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:56:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3650eed4-3692-40f0-8c9a-474ea07967cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd16fd8e-aa99-460b-9f75-bf515d3a0099', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8859b59a-b7a2-4577-a2a1-6b7be1a63d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:27 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Volume volume-dd16fd8e-aa99-460b-9f75-bf515d3a0099 (dd16fd8e-aa99-460b-9f75-bf515d3a0099): created successfully Nov 04 18:56:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8859b59a-b7a2-4577-a2a1-6b7be1a63d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Flow 'volume_create_manager' (60d4e4e1-52cb-46a6-a4f7-b222f6a3bfa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:56:27 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-7690a698-1a57-45a6-9fc2-94c24bdfd3b6 tempest-VolumesActionsTest-606381164 None] Created volume successfully. Nov 04 18:56:27 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-fc442150-f0ff-4b25-a3ad-2f948a10e21c tempest-VolumesActionsTest-672344341 None] Acquiring lock "cinder-dd16fd8e-aa99-460b-9f75-bf515d3a0099-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:56:27 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-fc442150-f0ff-4b25-a3ad-2f948a10e21c tempest-VolumesActionsTest-672344341 None] Lock "cinder-dd16fd8e-aa99-460b-9f75-bf515d3a0099-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:56:27 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-fc442150-f0ff-4b25-a3ad-2f948a10e21c tempest-VolumesActionsTest-672344341 None] Acquiring lock "cinder-quobyte-dd16fd8e-aa99-460b-9f75-bf515d3a0099" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:56:27 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-fc442150-f0ff-4b25-a3ad-2f948a10e21c tempest-VolumesActionsTest-672344341 None] Lock "cinder-quobyte-dd16fd8e-aa99-460b-9f75-bf515d3a0099" acquired by "delete_volume" :: waited 0.019s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:56:27 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b80000-88b9-403e-984b-595f681934e4]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:56:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-fc442150-f0ff-4b25-a3ad-2f948a10e21c tempest-VolumesActionsTest-672344341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dd16fd8e-aa99-460b-9f75-bf515d3a0099 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:28 devstack sudo[97350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dd16fd8e-aa99-460b-9f75-bf515d3a0099 Nov 04 18:56:28 devstack sudo[97350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f2f343e8-13fa-4d97-8e6e-74d4b2d9e245 tempest-VolumesActionsTest-1747258751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f2f343e8-13fa-4d97-8e6e-74d4b2d9e245 tempest-VolumesActionsTest-1747258751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:28 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db9e2fc-ae42-4c94-9a0b-5808d847282d]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:56:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f2f343e8-13fa-4d97-8e6e-74d4b2d9e245 tempest-VolumesActionsTest-1747258751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:28 devstack sudo[97350]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-fc442150-f0ff-4b25-a3ad-2f948a10e21c tempest-VolumesActionsTest-672344341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dd16fd8e-aa99-460b-9f75-bf515d3a0099" returned: 0 in 0.431s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-fc442150-f0ff-4b25-a3ad-2f948a10e21c tempest-VolumesActionsTest-672344341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dd16fd8e-aa99-460b-9f75-bf515d3a0099 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:28 devstack sudo[97356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dd16fd8e-aa99-460b-9f75-bf515d3a0099 Nov 04 18:56:28 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:28 devstack sudo[97353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667 Nov 04 18:56:28 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:28 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:28 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-fc442150-f0ff-4b25-a3ad-2f948a10e21c tempest-VolumesActionsTest-672344341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dd16fd8e-aa99-460b-9f75-bf515d3a0099" returned: 0 in 0.467s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f2f343e8-13fa-4d97-8e6e-74d4b2d9e245 tempest-VolumesActionsTest-1747258751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667" returned: 0 in 0.569s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:28 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-fc442150-f0ff-4b25-a3ad-2f948a10e21c tempest-VolumesActionsTest-672344341 None] Lock "cinder-quobyte-dd16fd8e-aa99-460b-9f75-bf515d3a0099" released by "delete_volume" :: held 0.949s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:56:28 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fb83d8-b26a-435a-96f5-494b29255360]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:56:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f2f343e8-13fa-4d97-8e6e-74d4b2d9e245 tempest-VolumesActionsTest-1747258751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:28 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-fc442150-f0ff-4b25-a3ad-2f948a10e21c tempest-VolumesActionsTest-672344341 None] Created reservations ['7a8e091d-7045-4b9f-9eb9-93c4020371e7', 'c188316d-a098-459f-b90e-6c3be8e795ba', '281fb393-621a-446a-b968-82653e9da604', '087fb381-1899-452d-b43a-81b5c6cda4d3'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:56:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-fc442150-f0ff-4b25-a3ad-2f948a10e21c tempest-VolumesActionsTest-672344341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-fc442150-f0ff-4b25-a3ad-2f948a10e21c tempest-VolumesActionsTest-672344341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-fc442150-f0ff-4b25-a3ad-2f948a10e21c tempest-VolumesActionsTest-672344341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:56:29 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667 Nov 04 18:56:29 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-fc442150-f0ff-4b25-a3ad-2f948a10e21c tempest-VolumesActionsTest-672344341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:56:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-fc442150-f0ff-4b25-a3ad-2f948a10e21c tempest-VolumesActionsTest-672344341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-fc442150-f0ff-4b25-a3ad-2f948a10e21c tempest-VolumesActionsTest-672344341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:29 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:56:29 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:29 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-fc442150-f0ff-4b25-a3ad-2f948a10e21c tempest-VolumesActionsTest-672344341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.336s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:29 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-fc442150-f0ff-4b25-a3ad-2f948a10e21c tempest-VolumesActionsTest-672344341 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:56:29 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-fc442150-f0ff-4b25-a3ad-2f948a10e21c tempest-VolumesActionsTest-672344341 None] Deleted volume successfully. Nov 04 18:56:29 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f2f343e8-13fa-4d97-8e6e-74d4b2d9e245 tempest-VolumesActionsTest-1747258751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667" returned: 0 in 0.538s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f2f343e8-13fa-4d97-8e6e-74d4b2d9e245 tempest-VolumesActionsTest-1747258751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667 /opt/stack/data/cinder/conversion/13c504c7-2402-44c6-a086-d673b18ee667.temp_image.a286fd93-20bf-4521-91f3-9d695d82ee5dvpedmb9u.img {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:29 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-fc442150-f0ff-4b25-a3ad-2f948a10e21c tempest-VolumesActionsTest-672344341 None] Lock "cinder-dd16fd8e-aa99-460b-9f75-bf515d3a0099-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:56:29 devstack sudo[97372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667 /opt/stack/data/cinder/conversion/13c504c7-2402-44c6-a086-d673b18ee667.temp_image.a286fd93-20bf-4521-91f3-9d695d82ee5dvpedmb9u.img Nov 04 18:56:29 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:31 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:56:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Flow 'volume_create_manager' (35056b91-5d13-42bd-97d3-13e7ac842cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:56:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc2b46e-c110-427e-9c83-ef49294a7637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc2b46e-c110-427e-9c83-ef49294a7637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1755858524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=126cf39a-9b27-43d1-947e-7156394b98e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8715a1993ff54d2bb90c2f858599db4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:56:31Z,use_quota=True,user_id='0bceb04d134e40dfab30dd39bf446259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14249c98-2c36-4617-84a2-31f101e2d8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14249c98-2c36-4617-84a2-31f101e2d8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4bc6e15-2de9-4bb9-859f-c3f787153614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4bc6e15-2de9-4bb9-859f-c3f787153614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '126cf39a-9b27-43d1-947e-7156394b98e2', 'volume_name': 'volume-126cf39a-9b27-43d1-947e-7156394b98e2', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38d4f169-f8ec-4a82-9533-4a8133052afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38d4f169-f8ec-4a82-9533-4a8133052afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (047d9279-6a84-47b1-b164-095a340bb72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:31 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Volume 126cf39a-9b27-43d1-947e-7156394b98e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-126cf39a-9b27-43d1-947e-7156394b98e2', 'volume_size': 1} Nov 04 18:56:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:37 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f2f343e8-13fa-4d97-8e6e-74d4b2d9e245 tempest-VolumesActionsTest-1747258751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667 /opt/stack/data/cinder/conversion/13c504c7-2402-44c6-a086-d673b18ee667.temp_image.a286fd93-20bf-4521-91f3-9d695d82ee5dvpedmb9u.img" returned: 0 in 8.498s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:37 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e621f7-d1a4-451c-9c6a-6b85938cdcbd]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:56:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f2f343e8-13fa-4d97-8e6e-74d4b2d9e245 tempest-VolumesActionsTest-1747258751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:38 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667 Nov 04 18:56:38 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:38 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f2f343e8-13fa-4d97-8e6e-74d4b2d9e245 tempest-VolumesActionsTest-1747258751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667" returned: 0 in 0.530s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:38 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-f2f343e8-13fa-4d97-8e6e-74d4b2d9e245 tempest-VolumesActionsTest-1747258751 None] Image conversion details: src /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667, size 1024.00 MB, duration 8.50 sec, destination /opt/stack/data/cinder/conversion/13c504c7-2402-44c6-a086-d673b18ee667.temp_image.a286fd93-20bf-4521-91f3-9d695d82ee5dvpedmb9u.img {{(pid=87119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 18:56:38 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-f2f343e8-13fa-4d97-8e6e-74d4b2d9e245 tempest-VolumesActionsTest-1747258751 None] Converted 1024.00 MB image at 120.49 MB/s Nov 04 18:56:38 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-f2f343e8-13fa-4d97-8e6e-74d4b2d9e245 tempest-VolumesActionsTest-1747258751 None] a286fd93-20bf-4521-91f3-9d695d82ee5d was raw, converting to qcow2 {{(pid=87119) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 04 18:56:38 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e4a376-4f7d-4b32-854d-d6ccc8625fd9]: (4, 'raw') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:56:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f2f343e8-13fa-4d97-8e6e-74d4b2d9e245 tempest-VolumesActionsTest-1747258751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/13c504c7-2402-44c6-a086-d673b18ee667.temp_image.a286fd93-20bf-4521-91f3-9d695d82ee5dvpedmb9u.img {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:38 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/13c504c7-2402-44c6-a086-d673b18ee667.temp_image.a286fd93-20bf-4521-91f3-9d695d82ee5dvpedmb9u.img Nov 04 18:56:38 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:38 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f2f343e8-13fa-4d97-8e6e-74d4b2d9e245 tempest-VolumesActionsTest-1747258751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/13c504c7-2402-44c6-a086-d673b18ee667.temp_image.a286fd93-20bf-4521-91f3-9d695d82ee5dvpedmb9u.img" returned: 0 in 0.322s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f2f343e8-13fa-4d97-8e6e-74d4b2d9e245 tempest-VolumesActionsTest-1747258751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/13c504c7-2402-44c6-a086-d673b18ee667.temp_image.a286fd93-20bf-4521-91f3-9d695d82ee5dvpedmb9u.img {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:38 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/13c504c7-2402-44c6-a086-d673b18ee667.temp_image.a286fd93-20bf-4521-91f3-9d695d82ee5dvpedmb9u.img Nov 04 18:56:38 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:39 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f2f343e8-13fa-4d97-8e6e-74d4b2d9e245 tempest-VolumesActionsTest-1747258751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/13c504c7-2402-44c6-a086-d673b18ee667.temp_image.a286fd93-20bf-4521-91f3-9d695d82ee5dvpedmb9u.img" returned: 1 in 0.327s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f2f343e8-13fa-4d97-8e6e-74d4b2d9e245 tempest-VolumesActionsTest-1747258751 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/13c504c7-2402-44c6-a086-d673b18ee667.temp_image.a286fd93-20bf-4521-91f3-9d695d82ee5dvpedmb9u.img' failed. Not Retrying. {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 18:56:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f2f343e8-13fa-4d97-8e6e-74d4b2d9e245 tempest-VolumesActionsTest-1747258751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/13c504c7-2402-44c6-a086-d673b18ee667.temp_image.a286fd93-20bf-4521-91f3-9d695d82ee5dvpedmb9u.img /opt/stack/data/cinder/conversion/vol_upload_2k_x3bpc {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:39 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/13c504c7-2402-44c6-a086-d673b18ee667.temp_image.a286fd93-20bf-4521-91f3-9d695d82ee5dvpedmb9u.img /opt/stack/data/cinder/conversion/vol_upload_2k_x3bpc Nov 04 18:56:39 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:39 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f2f343e8-13fa-4d97-8e6e-74d4b2d9e245 tempest-VolumesActionsTest-1747258751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/13c504c7-2402-44c6-a086-d673b18ee667.temp_image.a286fd93-20bf-4521-91f3-9d695d82ee5dvpedmb9u.img /opt/stack/data/cinder/conversion/vol_upload_2k_x3bpc" returned: 0 in 0.264s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:39 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-f2f343e8-13fa-4d97-8e6e-74d4b2d9e245 tempest-VolumesActionsTest-1747258751 None] Image conversion details: src /opt/stack/data/cinder/conversion/13c504c7-2402-44c6-a086-d673b18ee667.temp_image.a286fd93-20bf-4521-91f3-9d695d82ee5dvpedmb9u.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_2k_x3bpc {{(pid=87119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 18:56:39 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-f2f343e8-13fa-4d97-8e6e-74d4b2d9e245 tempest-VolumesActionsTest-1747258751 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 04 18:56:39 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ec11b5-b7a5-4054-aa39-7c92b26b87dc]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:56:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f2f343e8-13fa-4d97-8e6e-74d4b2d9e245 tempest-VolumesActionsTest-1747258751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2k_x3bpc {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:39 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2k_x3bpc Nov 04 18:56:39 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:39 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f2f343e8-13fa-4d97-8e6e-74d4b2d9e245 tempest-VolumesActionsTest-1747258751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2k_x3bpc" returned: 0 in 0.335s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f2f343e8-13fa-4d97-8e6e-74d4b2d9e245 tempest-VolumesActionsTest-1747258751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.895s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:41 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f2f343e8-13fa-4d97-8e6e-74d4b2d9e245 tempest-VolumesActionsTest-1747258751 None] Uploaded volume to glance image-id: a286fd93-20bf-4521-91f3-9d695d82ee5d. {{(pid=87119) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 04 18:56:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.232s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:41 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1755858524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=126cf39a-9b27-43d1-947e-7156394b98e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8715a1993ff54d2bb90c2f858599db4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:56:31Z,use_quota=True,user_id='0bceb04d134e40dfab30dd39bf446259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:56:41 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Creating volume 126cf39a-9b27-43d1-947e-7156394b98e2 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:56:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:41 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:56:41 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:56:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:41 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:56:41 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:56:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-126cf39a-9b27-43d1-947e-7156394b98e2 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:41 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-126cf39a-9b27-43d1-947e-7156394b98e2 1073741824 Nov 04 18:56:41 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:41 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-f2f343e8-13fa-4d97-8e6e-74d4b2d9e245 tempest-VolumesActionsTest-1747258751 None] Copy volume to image completed successfully. Nov 04 18:56:41 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-126cf39a-9b27-43d1-947e-7156394b98e2 1073741824" returned: 0 in 0.492s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-126cf39a-9b27-43d1-947e-7156394b98e2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:41 devstack sudo[97448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-126cf39a-9b27-43d1-947e-7156394b98e2 Nov 04 18:56:41 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:42 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-126cf39a-9b27-43d1-947e-7156394b98e2" returned: 0 in 0.381s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:42 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:56:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (047d9279-6a84-47b1-b164-095a340bb72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-126cf39a-9b27-43d1-947e-7156394b98e2', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c56318c-c45f-47ac-a196-669ef50a3b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:42 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Volume volume-126cf39a-9b27-43d1-947e-7156394b98e2 (126cf39a-9b27-43d1-947e-7156394b98e2): created successfully Nov 04 18:56:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c56318c-c45f-47ac-a196-669ef50a3b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Flow 'volume_create_manager' (35056b91-5d13-42bd-97d3-13e7ac842cc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:56:42 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-b9cd96f0-af31-4b1e-8bea-1735713178d3 tempest-VolumesActionsTest-606381164 None] Created volume successfully. Nov 04 18:56:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b074cf81-5ec3-4f92-a47c-9c1c5782e791 tempest-VolumesActionsTest-672344341 None] Acquiring lock "cinder-126cf39a-9b27-43d1-947e-7156394b98e2-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:56:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b074cf81-5ec3-4f92-a47c-9c1c5782e791 tempest-VolumesActionsTest-672344341 None] Lock "cinder-126cf39a-9b27-43d1-947e-7156394b98e2-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:56:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b074cf81-5ec3-4f92-a47c-9c1c5782e791 tempest-VolumesActionsTest-672344341 None] Acquiring lock "cinder-quobyte-126cf39a-9b27-43d1-947e-7156394b98e2" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:56:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b074cf81-5ec3-4f92-a47c-9c1c5782e791 tempest-VolumesActionsTest-672344341 None] Lock "cinder-quobyte-126cf39a-9b27-43d1-947e-7156394b98e2" acquired by "delete_volume" :: waited 0.034s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:56:43 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[407b6e59-b668-4860-9e11-9f2bb4685593]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:56:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b074cf81-5ec3-4f92-a47c-9c1c5782e791 tempest-VolumesActionsTest-672344341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-126cf39a-9b27-43d1-947e-7156394b98e2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-88d88eea-46b8-4841-9bec-b83157853b79 tempest-VolumesActionsTest-1747258751 None] Acquiring lock "cinder-13c504c7-2402-44c6-a086-d673b18ee667-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:56:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-88d88eea-46b8-4841-9bec-b83157853b79 tempest-VolumesActionsTest-1747258751 None] Lock "cinder-13c504c7-2402-44c6-a086-d673b18ee667-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:56:43 devstack sudo[97466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-126cf39a-9b27-43d1-947e-7156394b98e2 Nov 04 18:56:43 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-88d88eea-46b8-4841-9bec-b83157853b79 tempest-VolumesActionsTest-1747258751 None] Acquiring lock "cinder-quobyte-13c504c7-2402-44c6-a086-d673b18ee667" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:56:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-88d88eea-46b8-4841-9bec-b83157853b79 tempest-VolumesActionsTest-1747258751 None] Lock "cinder-quobyte-13c504c7-2402-44c6-a086-d673b18ee667" acquired by "delete_volume" :: waited 0.030s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:56:43 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e717491-7a88-4d5b-bb75-2773ccfcb4ab]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:56:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-88d88eea-46b8-4841-9bec-b83157853b79 tempest-VolumesActionsTest-1747258751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:43 devstack sudo[97470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667 Nov 04 18:56:43 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:43 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b074cf81-5ec3-4f92-a47c-9c1c5782e791 tempest-VolumesActionsTest-672344341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-126cf39a-9b27-43d1-947e-7156394b98e2" returned: 0 in 0.586s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b074cf81-5ec3-4f92-a47c-9c1c5782e791 tempest-VolumesActionsTest-672344341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-126cf39a-9b27-43d1-947e-7156394b98e2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:43 devstack sudo[97475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-126cf39a-9b27-43d1-947e-7156394b98e2 Nov 04 18:56:43 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:43 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-88d88eea-46b8-4841-9bec-b83157853b79 tempest-VolumesActionsTest-1747258751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667" returned: 0 in 0.439s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-88d88eea-46b8-4841-9bec-b83157853b79 tempest-VolumesActionsTest-1747258751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:43 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667 Nov 04 18:56:43 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:44 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b074cf81-5ec3-4f92-a47c-9c1c5782e791 tempest-VolumesActionsTest-672344341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-126cf39a-9b27-43d1-947e-7156394b98e2" returned: 0 in 0.342s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b074cf81-5ec3-4f92-a47c-9c1c5782e791 tempest-VolumesActionsTest-672344341 None] Lock "cinder-quobyte-126cf39a-9b27-43d1-947e-7156394b98e2" released by "delete_volume" :: held 1.031s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:56:44 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-b074cf81-5ec3-4f92-a47c-9c1c5782e791 tempest-VolumesActionsTest-672344341 None] Created reservations ['b3ba3ea5-fe9a-4fa6-bdf7-d637b4cda85c', '8bf1486a-19cd-4668-b976-2e688fcc5329', '2ea03cd5-b01f-4415-b107-040997bda240', '18f07833-1e5a-4d37-aac4-86e9e6433555'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:56:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b074cf81-5ec3-4f92-a47c-9c1c5782e791 tempest-VolumesActionsTest-672344341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b074cf81-5ec3-4f92-a47c-9c1c5782e791 tempest-VolumesActionsTest-672344341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:44 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-b074cf81-5ec3-4f92-a47c-9c1c5782e791 tempest-VolumesActionsTest-672344341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:56:44 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-b074cf81-5ec3-4f92-a47c-9c1c5782e791 tempest-VolumesActionsTest-672344341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:56:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b074cf81-5ec3-4f92-a47c-9c1c5782e791 tempest-VolumesActionsTest-672344341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:44 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b074cf81-5ec3-4f92-a47c-9c1c5782e791 tempest-VolumesActionsTest-672344341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-88d88eea-46b8-4841-9bec-b83157853b79 tempest-VolumesActionsTest-1747258751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13c504c7-2402-44c6-a086-d673b18ee667" returned: 0 in 0.376s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:44 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:56:44 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-88d88eea-46b8-4841-9bec-b83157853b79 tempest-VolumesActionsTest-1747258751 None] Lock "cinder-quobyte-13c504c7-2402-44c6-a086-d673b18ee667" released by "delete_volume" :: held 0.875s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:56:44 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-88d88eea-46b8-4841-9bec-b83157853b79 tempest-VolumesActionsTest-1747258751 None] Created reservations ['1c224b3b-5d31-45b6-aa8f-5a4bacfd89f8', '55dcb097-b4c2-48c0-92fd-11cd0bf1e115', 'b1f54fff-6a61-4562-abfe-64f91cd2b3aa', 'f1a20cf1-479d-4f9a-924e-4210d2c525c3'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:56:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-88d88eea-46b8-4841-9bec-b83157853b79 tempest-VolumesActionsTest-1747258751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-88d88eea-46b8-4841-9bec-b83157853b79 tempest-VolumesActionsTest-1747258751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:44 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-88d88eea-46b8-4841-9bec-b83157853b79 tempest-VolumesActionsTest-1747258751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:56:44 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-88d88eea-46b8-4841-9bec-b83157853b79 tempest-VolumesActionsTest-1747258751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:56:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-88d88eea-46b8-4841-9bec-b83157853b79 tempest-VolumesActionsTest-1747258751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-88d88eea-46b8-4841-9bec-b83157853b79 tempest-VolumesActionsTest-1747258751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:44 devstack sudo[97488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:56:44 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:44 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b074cf81-5ec3-4f92-a47c-9c1c5782e791 tempest-VolumesActionsTest-672344341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.448s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:44 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-b074cf81-5ec3-4f92-a47c-9c1c5782e791 tempest-VolumesActionsTest-672344341 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:56:44 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-b074cf81-5ec3-4f92-a47c-9c1c5782e791 tempest-VolumesActionsTest-672344341 None] Deleted volume successfully. Nov 04 18:56:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b074cf81-5ec3-4f92-a47c-9c1c5782e791 tempest-VolumesActionsTest-672344341 None] Lock "cinder-126cf39a-9b27-43d1-947e-7156394b98e2-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:56:44 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-88d88eea-46b8-4841-9bec-b83157853b79 tempest-VolumesActionsTest-1747258751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.382s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:44 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-88d88eea-46b8-4841-9bec-b83157853b79 tempest-VolumesActionsTest-1747258751 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:56:44 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-88d88eea-46b8-4841-9bec-b83157853b79 tempest-VolumesActionsTest-1747258751 None] Deleted volume successfully. Nov 04 18:56:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-88d88eea-46b8-4841-9bec-b83157853b79 tempest-VolumesActionsTest-1747258751 None] Lock "cinder-13c504c7-2402-44c6-a086-d673b18ee667-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:56:45 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:56:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Flow 'volume_create_manager' (5e79410a-b68c-4fb9-919f-7520aa982844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:56:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c11ee7-1c25-4814-b4f3-76d5d6feb9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c11ee7-1c25-4814-b4f3-76d5d6feb9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1881461735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5580b7b-2559-436d-84d2-e97cbb8d845a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a89143e489b846c68d02b2c99b97d011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:56:45Z,use_quota=True,user_id='2df3cb21008e46d48baecb25ef9390f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b5e7762-a4c6-47a5-a075-f88b0dfe6ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b5e7762-a4c6-47a5-a075-f88b0dfe6ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ccaedd-f8a8-463d-b30f-dff86526717b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ccaedd-f8a8-463d-b30f-dff86526717b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5580b7b-2559-436d-84d2-e97cbb8d845a', 'volume_name': 'volume-f5580b7b-2559-436d-84d2-e97cbb8d845a', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06801585-11b8-49f0-a4ae-b2fcc0c95748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06801585-11b8-49f0-a4ae-b2fcc0c95748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (592c628e-5ba2-454e-8736-ec1b56a14385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:45 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Volume f5580b7b-2559-436d-84d2-e97cbb8d845a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5580b7b-2559-436d-84d2-e97cbb8d845a', 'volume_size': 1} Nov 04 18:56:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1881461735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5580b7b-2559-436d-84d2-e97cbb8d845a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a89143e489b846c68d02b2c99b97d011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:56:45Z,use_quota=True,user_id='2df3cb21008e46d48baecb25ef9390f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:56:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Creating volume f5580b7b-2559-436d-84d2-e97cbb8d845a {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:56:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:56:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:56:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:56:45 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:56:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f5580b7b-2559-436d-84d2-e97cbb8d845a 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:45 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f5580b7b-2559-436d-84d2-e97cbb8d845a 1073741824 Nov 04 18:56:45 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:46 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f5580b7b-2559-436d-84d2-e97cbb8d845a 1073741824" returned: 0 in 0.909s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f5580b7b-2559-436d-84d2-e97cbb8d845a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:46 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f5580b7b-2559-436d-84d2-e97cbb8d845a Nov 04 18:56:46 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:46 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:56:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Flow 'volume_create_manager' (df9397c3-22ca-491c-ad02-baaf15b5a342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:56:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab68029a-fd19-4375-a414-6540a63f89c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab68029a-fd19-4375-a414-6540a63f89c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-636920914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=068f5c50-2807-4974-bc13-1c209c0ed3e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8715a1993ff54d2bb90c2f858599db4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:56:46Z,use_quota=True,user_id='0bceb04d134e40dfab30dd39bf446259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2377563-ea6c-4848-939a-ba808320b0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2377563-ea6c-4848-939a-ba808320b0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1022aac7-65aa-47c6-aa96-03aafe83d4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1022aac7-65aa-47c6-aa96-03aafe83d4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '068f5c50-2807-4974-bc13-1c209c0ed3e3', 'volume_name': 'volume-068f5c50-2807-4974-bc13-1c209c0ed3e3', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc46bec-d6de-443a-bc51-301628025edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc46bec-d6de-443a-bc51-301628025edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (800e8d77-38a9-4afa-a0c2-3d39d459bfbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:46 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Volume 068f5c50-2807-4974-bc13-1c209c0ed3e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-068f5c50-2807-4974-bc13-1c209c0ed3e3', 'volume_size': 1} Nov 04 18:56:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:46 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f5580b7b-2559-436d-84d2-e97cbb8d845a" returned: 0 in 0.554s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:56:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.403s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-636920914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=068f5c50-2807-4974-bc13-1c209c0ed3e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8715a1993ff54d2bb90c2f858599db4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:56:46Z,use_quota=True,user_id='0bceb04d134e40dfab30dd39bf446259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:56:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Creating volume 068f5c50-2807-4974-bc13-1c209c0ed3e3 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:56:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:56:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:56:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:56:46 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:56:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-068f5c50-2807-4974-bc13-1c209c0ed3e3 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:47 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-068f5c50-2807-4974-bc13-1c209c0ed3e3 1073741824 Nov 04 18:56:47 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (592c628e-5ba2-454e-8736-ec1b56a14385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5580b7b-2559-436d-84d2-e97cbb8d845a', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8243395-37bc-4d69-b7b1-a52538fc0e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:47 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Volume volume-f5580b7b-2559-436d-84d2-e97cbb8d845a (f5580b7b-2559-436d-84d2-e97cbb8d845a): created successfully Nov 04 18:56:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8243395-37bc-4d69-b7b1-a52538fc0e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Flow 'volume_create_manager' (5e79410a-b68c-4fb9-919f-7520aa982844) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:56:47 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-9ed09b10-8ac6-4a0c-b28d-7dcf3eaaa0ec tempest-AttachVolumeNegativeTest-722614164 None] Created volume successfully. Nov 04 18:56:47 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-068f5c50-2807-4974-bc13-1c209c0ed3e3 1073741824" returned: 0 in 0.877s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-068f5c50-2807-4974-bc13-1c209c0ed3e3 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:48 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-068f5c50-2807-4974-bc13-1c209c0ed3e3 Nov 04 18:56:48 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:48 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-068f5c50-2807-4974-bc13-1c209c0ed3e3" returned: 0 in 0.532s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:56:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:48 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (800e8d77-38a9-4afa-a0c2-3d39d459bfbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-068f5c50-2807-4974-bc13-1c209c0ed3e3', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:48 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ecfdab-9f1d-4d3e-ac54-16a4edcdc301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:48 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Volume volume-068f5c50-2807-4974-bc13-1c209c0ed3e3 (068f5c50-2807-4974-bc13-1c209c0ed3e3): created successfully Nov 04 18:56:48 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ecfdab-9f1d-4d3e-ac54-16a4edcdc301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:48 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Flow 'volume_create_manager' (df9397c3-22ca-491c-ad02-baaf15b5a342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:56:48 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-256b9c30-dc03-4ff2-ad39-da129946d657 tempest-VolumesActionsTest-606381164 None] Created volume successfully. Nov 04 18:56:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-6752cd7b-ef1e-4ac9-a125-764a62eaef2f req-fcda3e53-fe97-42af-af45-7808614f9602 tempest-AttachVolumeNegativeTest-722614164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-6752cd7b-ef1e-4ac9-a125-764a62eaef2f req-fcda3e53-fe97-42af-af45-7808614f9602 tempest-AttachVolumeNegativeTest-722614164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-6752cd7b-ef1e-4ac9-a125-764a62eaef2f req-fcda3e53-fe97-42af-af45-7808614f9602 tempest-AttachVolumeNegativeTest-722614164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:48 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-6752cd7b-ef1e-4ac9-a125-764a62eaef2f req-fcda3e53-fe97-42af-af45-7808614f9602 tempest-AttachVolumeNegativeTest-722614164 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280', 'name': 'volume-f5580b7b-2559-436d-84d2-e97cbb8d845a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a1fda91-4032-419a-9b60-5d07c3e384a1', 'enforce_multipath': True} {{(pid=87119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:56:48 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-6752cd7b-ef1e-4ac9-a125-764a62eaef2f req-fcda3e53-fe97-42af-af45-7808614f9602 tempest-AttachVolumeNegativeTest-722614164 None] attachment_update completed successfully. Nov 04 18:56:49 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6520b736-f5a3-4495-9fa8-3c5ba2144290 tempest-VolumesActionsTest-672344341 None] Acquiring lock "cinder-068f5c50-2807-4974-bc13-1c209c0ed3e3-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:56:49 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6520b736-f5a3-4495-9fa8-3c5ba2144290 tempest-VolumesActionsTest-672344341 None] Lock "cinder-068f5c50-2807-4974-bc13-1c209c0ed3e3-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:56:50 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6520b736-f5a3-4495-9fa8-3c5ba2144290 tempest-VolumesActionsTest-672344341 None] Acquiring lock "cinder-quobyte-068f5c50-2807-4974-bc13-1c209c0ed3e3" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:56:50 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6520b736-f5a3-4495-9fa8-3c5ba2144290 tempest-VolumesActionsTest-672344341 None] Lock "cinder-quobyte-068f5c50-2807-4974-bc13-1c209c0ed3e3" acquired by "delete_volume" :: waited 0.039s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:56:50 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7145180-6f8a-4c1f-b8a0-0be07efeeef5]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:56:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6520b736-f5a3-4495-9fa8-3c5ba2144290 tempest-VolumesActionsTest-672344341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-068f5c50-2807-4974-bc13-1c209c0ed3e3 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:50 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-068f5c50-2807-4974-bc13-1c209c0ed3e3 Nov 04 18:56:50 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:50 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6520b736-f5a3-4495-9fa8-3c5ba2144290 tempest-VolumesActionsTest-672344341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-068f5c50-2807-4974-bc13-1c209c0ed3e3" returned: 0 in 0.479s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6520b736-f5a3-4495-9fa8-3c5ba2144290 tempest-VolumesActionsTest-672344341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-068f5c50-2807-4974-bc13-1c209c0ed3e3 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:50 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-068f5c50-2807-4974-bc13-1c209c0ed3e3 Nov 04 18:56:50 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:51 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6520b736-f5a3-4495-9fa8-3c5ba2144290 tempest-VolumesActionsTest-672344341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-068f5c50-2807-4974-bc13-1c209c0ed3e3" returned: 0 in 0.377s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:51 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6520b736-f5a3-4495-9fa8-3c5ba2144290 tempest-VolumesActionsTest-672344341 None] Lock "cinder-quobyte-068f5c50-2807-4974-bc13-1c209c0ed3e3" released by "delete_volume" :: held 0.939s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:56:51 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-6520b736-f5a3-4495-9fa8-3c5ba2144290 tempest-VolumesActionsTest-672344341 None] Created reservations ['b676f59c-131d-4e4d-acf3-bcccca675550', '9a17fc58-cd23-491c-be61-709e72e46465', '67b15647-d85b-4879-a3b8-01cfbfdb736f', '1ada4642-3dea-4cef-97b3-a612b7cb1327'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:56:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6520b736-f5a3-4495-9fa8-3c5ba2144290 tempest-VolumesActionsTest-672344341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6520b736-f5a3-4495-9fa8-3c5ba2144290 tempest-VolumesActionsTest-672344341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:51 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-6520b736-f5a3-4495-9fa8-3c5ba2144290 tempest-VolumesActionsTest-672344341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:56:51 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-6520b736-f5a3-4495-9fa8-3c5ba2144290 tempest-VolumesActionsTest-672344341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:56:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6520b736-f5a3-4495-9fa8-3c5ba2144290 tempest-VolumesActionsTest-672344341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6520b736-f5a3-4495-9fa8-3c5ba2144290 tempest-VolumesActionsTest-672344341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:51 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:56:51 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:51 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6520b736-f5a3-4495-9fa8-3c5ba2144290 tempest-VolumesActionsTest-672344341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.398s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:51 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-6520b736-f5a3-4495-9fa8-3c5ba2144290 tempest-VolumesActionsTest-672344341 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:56:51 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-6520b736-f5a3-4495-9fa8-3c5ba2144290 tempest-VolumesActionsTest-672344341 None] Deleted volume successfully. Nov 04 18:56:51 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6520b736-f5a3-4495-9fa8-3c5ba2144290 tempest-VolumesActionsTest-672344341 None] Lock "cinder-068f5c50-2807-4974-bc13-1c209c0ed3e3-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:56:53 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:56:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Flow 'volume_create_manager' (f25a2c00-9f57-4c24-88c9-c415d797a0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:56:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d802410e-bd90-4c64-b628-e005d1fc4c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d802410e-bd90-4c64-b628-e005d1fc4c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-477660770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd6813b-f3c4-4310-80be-be96845866db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8715a1993ff54d2bb90c2f858599db4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:56:53Z,use_quota=True,user_id='0bceb04d134e40dfab30dd39bf446259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cf32932-c111-4a98-a1bc-64a60ec7f485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cf32932-c111-4a98-a1bc-64a60ec7f485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35e5cf81-7951-4490-a095-a09f3c9f4a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35e5cf81-7951-4490-a095-a09f3c9f4a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcd6813b-f3c4-4310-80be-be96845866db', 'volume_name': 'volume-bcd6813b-f3c4-4310-80be-be96845866db', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e4eac2-5bf3-4fb1-8552-d02255730aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e4eac2-5bf3-4fb1-8552-d02255730aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (502f4f32-5818-4596-8945-87739ce9e773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:53 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Volume bcd6813b-f3c4-4310-80be-be96845866db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcd6813b-f3c4-4310-80be-be96845866db', 'volume_size': 1} Nov 04 18:56:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:53 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-477660770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd6813b-f3c4-4310-80be-be96845866db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8715a1993ff54d2bb90c2f858599db4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:56:53Z,use_quota=True,user_id='0bceb04d134e40dfab30dd39bf446259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:56:53 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Creating volume bcd6813b-f3c4-4310-80be-be96845866db {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:56:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:53 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:56:53 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:56:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:53 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:56:53 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:56:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bcd6813b-f3c4-4310-80be-be96845866db 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:53 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bcd6813b-f3c4-4310-80be-be96845866db 1073741824 Nov 04 18:56:53 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:53 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bcd6813b-f3c4-4310-80be-be96845866db 1073741824" returned: 0 in 0.625s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bcd6813b-f3c4-4310-80be-be96845866db {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:53 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bcd6813b-f3c4-4310-80be-be96845866db Nov 04 18:56:53 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:54 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bcd6813b-f3c4-4310-80be-be96845866db" returned: 0 in 0.320s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:54 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:56:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:54 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (502f4f32-5818-4596-8945-87739ce9e773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcd6813b-f3c4-4310-80be-be96845866db', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:54 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6529be59-14b9-4b6e-a76d-ffeb39427782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:54 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Volume volume-bcd6813b-f3c4-4310-80be-be96845866db (bcd6813b-f3c4-4310-80be-be96845866db): created successfully Nov 04 18:56:54 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6529be59-14b9-4b6e-a76d-ffeb39427782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:54 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Flow 'volume_create_manager' (f25a2c00-9f57-4c24-88c9-c415d797a0ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:56:54 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-274126e9-c9b6-4439-847d-93b952c9220e tempest-VolumesActionsTest-606381164 None] Created volume successfully. Nov 04 18:56:55 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-16363d49-cb45-4302-8f33-93cd0c431f57 tempest-VolumesActionsTest-672344341 None] Acquiring lock "cinder-bcd6813b-f3c4-4310-80be-be96845866db-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:56:55 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-16363d49-cb45-4302-8f33-93cd0c431f57 tempest-VolumesActionsTest-672344341 None] Lock "cinder-bcd6813b-f3c4-4310-80be-be96845866db-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:56:55 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-16363d49-cb45-4302-8f33-93cd0c431f57 tempest-VolumesActionsTest-672344341 None] Acquiring lock "cinder-quobyte-bcd6813b-f3c4-4310-80be-be96845866db" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:56:55 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-16363d49-cb45-4302-8f33-93cd0c431f57 tempest-VolumesActionsTest-672344341 None] Lock "cinder-quobyte-bcd6813b-f3c4-4310-80be-be96845866db" acquired by "delete_volume" :: waited 0.019s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:56:55 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7692551-4b47-4e85-acfc-0ea69870cf45]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:56:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-16363d49-cb45-4302-8f33-93cd0c431f57 tempest-VolumesActionsTest-672344341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bcd6813b-f3c4-4310-80be-be96845866db {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:55 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bcd6813b-f3c4-4310-80be-be96845866db Nov 04 18:56:55 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:56 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-16363d49-cb45-4302-8f33-93cd0c431f57 tempest-VolumesActionsTest-672344341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bcd6813b-f3c4-4310-80be-be96845866db" returned: 0 in 0.565s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-16363d49-cb45-4302-8f33-93cd0c431f57 tempest-VolumesActionsTest-672344341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bcd6813b-f3c4-4310-80be-be96845866db {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:56 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bcd6813b-f3c4-4310-80be-be96845866db Nov 04 18:56:56 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:56 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-16363d49-cb45-4302-8f33-93cd0c431f57 tempest-VolumesActionsTest-672344341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bcd6813b-f3c4-4310-80be-be96845866db" returned: 0 in 0.306s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:56 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-16363d49-cb45-4302-8f33-93cd0c431f57 tempest-VolumesActionsTest-672344341 None] Lock "cinder-quobyte-bcd6813b-f3c4-4310-80be-be96845866db" released by "delete_volume" :: held 0.929s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:56:56 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-16363d49-cb45-4302-8f33-93cd0c431f57 tempest-VolumesActionsTest-672344341 None] Created reservations ['dfc0fff0-e332-4f75-acad-49622bd50107', '7bc54462-24db-40cb-b518-8ebd06ad83e9', '4dd50592-47ab-4c8e-a7e0-fd778e26dcd1', '752c64f5-6d26-4668-9443-e14f46813d48'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:56:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-16363d49-cb45-4302-8f33-93cd0c431f57 tempest-VolumesActionsTest-672344341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-16363d49-cb45-4302-8f33-93cd0c431f57 tempest-VolumesActionsTest-672344341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:56 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-16363d49-cb45-4302-8f33-93cd0c431f57 tempest-VolumesActionsTest-672344341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:56:56 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-16363d49-cb45-4302-8f33-93cd0c431f57 tempest-VolumesActionsTest-672344341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:56:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-16363d49-cb45-4302-8f33-93cd0c431f57 tempest-VolumesActionsTest-672344341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-16363d49-cb45-4302-8f33-93cd0c431f57 tempest-VolumesActionsTest-672344341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:56 devstack sudo[98076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:56:56 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:57 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-16363d49-cb45-4302-8f33-93cd0c431f57 tempest-VolumesActionsTest-672344341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.391s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:57 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-16363d49-cb45-4302-8f33-93cd0c431f57 tempest-VolumesActionsTest-672344341 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:56:57 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-16363d49-cb45-4302-8f33-93cd0c431f57 tempest-VolumesActionsTest-672344341 None] Deleted volume successfully. Nov 04 18:56:57 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-16363d49-cb45-4302-8f33-93cd0c431f57 tempest-VolumesActionsTest-672344341 None] Lock "cinder-bcd6813b-f3c4-4310-80be-be96845866db-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:56:57 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:56:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Flow 'volume_create_manager' (9ec90f5b-2a4c-430c-a517-0aef3dfcfe48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:56:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd932f6e-1333-4262-9723-35948cce56c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd932f6e-1333-4262-9723-35948cce56c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-258000426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=489d3f4b-61c4-4e8b-b33d-7cfb4fed38bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc6b238d07514791bec6f4a3cad5f55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:56:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:56:58Z,use_quota=True,user_id='910243a844c341ca8021efc57812277b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252ee8b3-547e-42f5-88a2-80f3224c3800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252ee8b3-547e-42f5-88a2-80f3224c3800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b4fd2f-0b55-4d0d-8423-d3c238827d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b4fd2f-0b55-4d0d-8423-d3c238827d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '489d3f4b-61c4-4e8b-b33d-7cfb4fed38bb', 'volume_name': 'volume-489d3f4b-61c4-4e8b-b33d-7cfb4fed38bb', 'volume_size': 2}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8204cc1e-8bc1-4064-8d3b-781313da746c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8204cc1e-8bc1-4064-8d3b-781313da746c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1979bf3-f93d-4502-b838-ce6a4bcd718b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:57 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Volume 489d3f4b-61c4-4e8b-b33d-7cfb4fed38bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-489d3f4b-61c4-4e8b-b33d-7cfb4fed38bb', 'volume_size': 2} Nov 04 18:56:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-258000426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=489d3f4b-61c4-4e8b-b33d-7cfb4fed38bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc6b238d07514791bec6f4a3cad5f55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:56:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:56:58Z,use_quota=True,user_id='910243a844c341ca8021efc57812277b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:56:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Creating volume 489d3f4b-61c4-4e8b-b33d-7cfb4fed38bb {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:56:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:56:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:56:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:56:57 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:56:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-489d3f4b-61c4-4e8b-b33d-7cfb4fed38bb 2147483648 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:57 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-489d3f4b-61c4-4e8b-b33d-7cfb4fed38bb 2147483648 Nov 04 18:56:57 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:58 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:56:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Flow 'volume_create_manager' (49c52727-0652-4558-9eea-38bb0d3f333d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:56:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9f4f8b-03c8-4dea-b816-a16abc0d322f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9f4f8b-03c8-4dea-b816-a16abc0d322f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2045664283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b86d900-fc6e-4d87-826f-7013d6169cc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8715a1993ff54d2bb90c2f858599db4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:56:58Z,use_quota=True,user_id='0bceb04d134e40dfab30dd39bf446259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9111b19-36b0-4cb7-9d9a-2635e599289c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9111b19-36b0-4cb7-9d9a-2635e599289c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29541a92-545e-47b2-9dc3-59408dffaa4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29541a92-545e-47b2-9dc3-59408dffaa4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b86d900-fc6e-4d87-826f-7013d6169cc0', 'volume_name': 'volume-4b86d900-fc6e-4d87-826f-7013d6169cc0', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e44588-afd8-4008-8d8c-612c5a18e1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e44588-afd8-4008-8d8c-612c5a18e1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f7497b-a49f-4270-89f1-5e4d5a5dd6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:58 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Volume 4b86d900-fc6e-4d87-826f-7013d6169cc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b86d900-fc6e-4d87-826f-7013d6169cc0', 'volume_size': 1} Nov 04 18:56:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:58 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-489d3f4b-61c4-4e8b-b33d-7cfb4fed38bb 2147483648" returned: 0 in 0.888s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-489d3f4b-61c4-4e8b-b33d-7cfb4fed38bb {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:58 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-489d3f4b-61c4-4e8b-b33d-7cfb4fed38bb Nov 04 18:56:58 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:59 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-489d3f4b-61c4-4e8b-b33d-7cfb4fed38bb" returned: 0 in 0.344s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:59 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:56:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.549s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:59 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2045664283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b86d900-fc6e-4d87-826f-7013d6169cc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8715a1993ff54d2bb90c2f858599db4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:56:58Z,use_quota=True,user_id='0bceb04d134e40dfab30dd39bf446259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:56:59 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Creating volume 4b86d900-fc6e-4d87-826f-7013d6169cc0 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:56:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:59 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:56:59 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:56:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:59 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:56:59 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:56:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4b86d900-fc6e-4d87-826f-7013d6169cc0 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1979bf3-f93d-4502-b838-ce6a4bcd718b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-489d3f4b-61c4-4e8b-b33d-7cfb4fed38bb', 'volume_size': 2}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:59 devstack sudo[98103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4b86d900-fc6e-4d87-826f-7013d6169cc0 1073741824 Nov 04 18:56:59 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4507f70-a84a-458a-8aa0-87e83518ba09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:59 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Volume volume-489d3f4b-61c4-4e8b-b33d-7cfb4fed38bb (489d3f4b-61c4-4e8b-b33d-7cfb4fed38bb): created successfully Nov 04 18:56:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4507f70-a84a-458a-8aa0-87e83518ba09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Flow 'volume_create_manager' (9ec90f5b-2a4c-430c-a517-0aef3dfcfe48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:56:59 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-18ad9a33-95fa-4edd-8634-0abe4734d8c8 tempest-VolumesCloneNegativeTest-1330077237 None] Created volume successfully. Nov 04 18:56:59 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4b86d900-fc6e-4d87-826f-7013d6169cc0 1073741824" returned: 0 in 0.586s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4b86d900-fc6e-4d87-826f-7013d6169cc0 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:59 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4b86d900-fc6e-4d87-826f-7013d6169cc0 Nov 04 18:56:59 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:00 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ded2b5f2-e6b4-4205-ab41-287221fb0b23 tempest-VolumesCloneNegativeTest-1330077237 None] Acquiring lock "cinder-489d3f4b-61c4-4e8b-b33d-7cfb4fed38bb-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:00 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ded2b5f2-e6b4-4205-ab41-287221fb0b23 tempest-VolumesCloneNegativeTest-1330077237 None] Lock "cinder-489d3f4b-61c4-4e8b-b33d-7cfb4fed38bb-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:00 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ded2b5f2-e6b4-4205-ab41-287221fb0b23 tempest-VolumesCloneNegativeTest-1330077237 None] Acquiring lock "cinder-quobyte-489d3f4b-61c4-4e8b-b33d-7cfb4fed38bb" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:00 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ded2b5f2-e6b4-4205-ab41-287221fb0b23 tempest-VolumesCloneNegativeTest-1330077237 None] Lock "cinder-quobyte-489d3f4b-61c4-4e8b-b33d-7cfb4fed38bb" acquired by "delete_volume" :: waited 0.021s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:00 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a949b63-d4b3-4e32-8af6-132e27eb3b58]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ded2b5f2-e6b4-4205-ab41-287221fb0b23 tempest-VolumesCloneNegativeTest-1330077237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-489d3f4b-61c4-4e8b-b33d-7cfb4fed38bb {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:00 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4b86d900-fc6e-4d87-826f-7013d6169cc0" returned: 0 in 0.421s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:00 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:57:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:00 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f7497b-a49f-4270-89f1-5e4d5a5dd6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b86d900-fc6e-4d87-826f-7013d6169cc0', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:00 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5edb3a6-5a39-406c-b9ba-ff2a7242552c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:00 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Volume volume-4b86d900-fc6e-4d87-826f-7013d6169cc0 (4b86d900-fc6e-4d87-826f-7013d6169cc0): created successfully Nov 04 18:57:00 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5edb3a6-5a39-406c-b9ba-ff2a7242552c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:00 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Flow 'volume_create_manager' (49c52727-0652-4558-9eea-38bb0d3f333d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:00 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-389ab742-57df-4136-8611-e2cba729a6a6 tempest-VolumesActionsTest-606381164 None] Created volume successfully. Nov 04 18:57:00 devstack sudo[98116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-489d3f4b-61c4-4e8b-b33d-7cfb4fed38bb Nov 04 18:57:00 devstack sudo[98116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:00 devstack sudo[98116]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ded2b5f2-e6b4-4205-ab41-287221fb0b23 tempest-VolumesCloneNegativeTest-1330077237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-489d3f4b-61c4-4e8b-b33d-7cfb4fed38bb" returned: 0 in 0.503s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ded2b5f2-e6b4-4205-ab41-287221fb0b23 tempest-VolumesCloneNegativeTest-1330077237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-489d3f4b-61c4-4e8b-b33d-7cfb4fed38bb {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:00 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-489d3f4b-61c4-4e8b-b33d-7cfb4fed38bb Nov 04 18:57:00 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:01 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ded2b5f2-e6b4-4205-ab41-287221fb0b23 tempest-VolumesCloneNegativeTest-1330077237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-489d3f4b-61c4-4e8b-b33d-7cfb4fed38bb" returned: 0 in 0.334s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:01 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ded2b5f2-e6b4-4205-ab41-287221fb0b23 tempest-VolumesCloneNegativeTest-1330077237 None] Lock "cinder-quobyte-489d3f4b-61c4-4e8b-b33d-7cfb4fed38bb" released by "delete_volume" :: held 0.907s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:01 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-ded2b5f2-e6b4-4205-ab41-287221fb0b23 tempest-VolumesCloneNegativeTest-1330077237 None] Created reservations ['d600871e-b2c1-4a4b-a217-23625ee1e7f1', '1357ac71-bd2b-4c77-9efd-fd5dbd9b13b5', '8f30b3c7-1dc9-409c-8cc8-2006dc29e694', '1a373c6f-65d3-4b30-892a-aa4d25866873'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:57:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ded2b5f2-e6b4-4205-ab41-287221fb0b23 tempest-VolumesCloneNegativeTest-1330077237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ded2b5f2-e6b4-4205-ab41-287221fb0b23 tempest-VolumesCloneNegativeTest-1330077237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:01 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ded2b5f2-e6b4-4205-ab41-287221fb0b23 tempest-VolumesCloneNegativeTest-1330077237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:01 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ded2b5f2-e6b4-4205-ab41-287221fb0b23 tempest-VolumesCloneNegativeTest-1330077237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ded2b5f2-e6b4-4205-ab41-287221fb0b23 tempest-VolumesCloneNegativeTest-1330077237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ded2b5f2-e6b4-4205-ab41-287221fb0b23 tempest-VolumesCloneNegativeTest-1330077237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:01 devstack sudo[98143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:57:01 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:01 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-950fab6c-5400-46c4-b986-eb94220e8692 tempest-VolumesActionsTest-606381164 None] Acquiring lock "cinder-4b86d900-fc6e-4d87-826f-7013d6169cc0-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:01 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-950fab6c-5400-46c4-b986-eb94220e8692 tempest-VolumesActionsTest-606381164 None] Lock "cinder-4b86d900-fc6e-4d87-826f-7013d6169cc0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:01 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-950fab6c-5400-46c4-b986-eb94220e8692 tempest-VolumesActionsTest-606381164 None] Acquiring lock "cinder-quobyte-4b86d900-fc6e-4d87-826f-7013d6169cc0" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:01 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-950fab6c-5400-46c4-b986-eb94220e8692 tempest-VolumesActionsTest-606381164 None] Lock "cinder-quobyte-4b86d900-fc6e-4d87-826f-7013d6169cc0" acquired by "delete_volume" :: waited 0.019s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:01 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[583ce448-23b3-412f-8208-9e4caf9ee0a1]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-950fab6c-5400-46c4-b986-eb94220e8692 tempest-VolumesActionsTest-606381164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4b86d900-fc6e-4d87-826f-7013d6169cc0 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:01 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ded2b5f2-e6b4-4205-ab41-287221fb0b23 tempest-VolumesCloneNegativeTest-1330077237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.457s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:01 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-ded2b5f2-e6b4-4205-ab41-287221fb0b23 tempest-VolumesCloneNegativeTest-1330077237 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:57:01 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-ded2b5f2-e6b4-4205-ab41-287221fb0b23 tempest-VolumesCloneNegativeTest-1330077237 None] Deleted volume successfully. Nov 04 18:57:01 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ded2b5f2-e6b4-4205-ab41-287221fb0b23 tempest-VolumesCloneNegativeTest-1330077237 None] Lock "cinder-489d3f4b-61c4-4e8b-b33d-7cfb4fed38bb-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:01 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4b86d900-fc6e-4d87-826f-7013d6169cc0 Nov 04 18:57:01 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:02 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-950fab6c-5400-46c4-b986-eb94220e8692 tempest-VolumesActionsTest-606381164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4b86d900-fc6e-4d87-826f-7013d6169cc0" returned: 0 in 0.593s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-950fab6c-5400-46c4-b986-eb94220e8692 tempest-VolumesActionsTest-606381164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4b86d900-fc6e-4d87-826f-7013d6169cc0 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:02 devstack sudo[98163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4b86d900-fc6e-4d87-826f-7013d6169cc0 Nov 04 18:57:02 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:02 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-950fab6c-5400-46c4-b986-eb94220e8692 tempest-VolumesActionsTest-606381164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4b86d900-fc6e-4d87-826f-7013d6169cc0" returned: 0 in 0.562s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:02 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-950fab6c-5400-46c4-b986-eb94220e8692 tempest-VolumesActionsTest-606381164 None] Lock "cinder-quobyte-4b86d900-fc6e-4d87-826f-7013d6169cc0" released by "delete_volume" :: held 1.234s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:03 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-950fab6c-5400-46c4-b986-eb94220e8692 tempest-VolumesActionsTest-606381164 None] Created reservations ['e4315831-3743-4883-8fb9-a38dc9f452ce', '7228be2c-abbe-4fcc-a188-506a04542580', 'fb0f920a-1ab8-46ed-9af9-5cf34c28d2a0', 'cbc5af82-7aba-4a77-8651-c73e65fcfb73'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:57:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-950fab6c-5400-46c4-b986-eb94220e8692 tempest-VolumesActionsTest-606381164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-950fab6c-5400-46c4-b986-eb94220e8692 tempest-VolumesActionsTest-606381164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-950fab6c-5400-46c4-b986-eb94220e8692 tempest-VolumesActionsTest-606381164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-950fab6c-5400-46c4-b986-eb94220e8692 tempest-VolumesActionsTest-606381164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-950fab6c-5400-46c4-b986-eb94220e8692 tempest-VolumesActionsTest-606381164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-950fab6c-5400-46c4-b986-eb94220e8692 tempest-VolumesActionsTest-606381164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:03 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:57:03 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:03 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-950fab6c-5400-46c4-b986-eb94220e8692 tempest-VolumesActionsTest-606381164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.336s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:03 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-950fab6c-5400-46c4-b986-eb94220e8692 tempest-VolumesActionsTest-606381164 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:57:03 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-950fab6c-5400-46c4-b986-eb94220e8692 tempest-VolumesActionsTest-606381164 None] Deleted volume successfully. Nov 04 18:57:03 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-950fab6c-5400-46c4-b986-eb94220e8692 tempest-VolumesActionsTest-606381164 None] Lock "cinder-4b86d900-fc6e-4d87-826f-7013d6169cc0-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:08 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:57:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Flow 'volume_create_manager' (98485e39-8451-4b25-a415-f8afa259f4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da352a0-4af0-4b9c-aea5-5c66a1823e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da352a0-4af0-4b9c-aea5-5c66a1823e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-426244610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6396838f-e005-4280-ad17-53cbc888b02a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1d3ac79aa174707b10cceac9efa051b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:08Z,use_quota=True,user_id='03a66866de2944669a60acada0293560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c83c3e81-8903-425f-9f6f-ef8183527b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c83c3e81-8903-425f-9f6f-ef8183527b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2098c274-1672-4b54-8833-136bf94b6ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2098c274-1672-4b54-8833-136bf94b6ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6396838f-e005-4280-ad17-53cbc888b02a', 'volume_name': 'volume-6396838f-e005-4280-ad17-53cbc888b02a', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d768bed9-2e72-49be-9021-50221958147d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d768bed9-2e72-49be-9021-50221958147d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a216a03-64c4-49a9-a4b0-ae931774c98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:08 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Volume 6396838f-e005-4280-ad17-53cbc888b02a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6396838f-e005-4280-ad17-53cbc888b02a', 'volume_size': 1} Nov 04 18:57:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-426244610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6396838f-e005-4280-ad17-53cbc888b02a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1d3ac79aa174707b10cceac9efa051b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:08Z,use_quota=True,user_id='03a66866de2944669a60acada0293560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:57:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Creating volume 6396838f-e005-4280-ad17-53cbc888b02a {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:57:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:57:08 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:57:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6396838f-e005-4280-ad17-53cbc888b02a 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:08 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6396838f-e005-4280-ad17-53cbc888b02a 1073741824 Nov 04 18:57:08 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:09 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6396838f-e005-4280-ad17-53cbc888b02a 1073741824" returned: 0 in 0.539s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6396838f-e005-4280-ad17-53cbc888b02a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:09 devstack sudo[98212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6396838f-e005-4280-ad17-53cbc888b02a Nov 04 18:57:09 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:09 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6396838f-e005-4280-ad17-53cbc888b02a" returned: 0 in 0.376s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:57:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a216a03-64c4-49a9-a4b0-ae931774c98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6396838f-e005-4280-ad17-53cbc888b02a', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668c4155-f251-4b21-8a11-493cbfb297d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:09 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Volume volume-6396838f-e005-4280-ad17-53cbc888b02a (6396838f-e005-4280-ad17-53cbc888b02a): created successfully Nov 04 18:57:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668c4155-f251-4b21-8a11-493cbfb297d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Flow 'volume_create_manager' (98485e39-8451-4b25-a415-f8afa259f4fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:09 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-5c872bff-e865-426d-80a6-0621dda187d4 tempest-VolumesListTestJSON-156550522 None] Created volume successfully. Nov 04 18:57:11 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:57:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Flow 'volume_create_manager' (3eb55fff-e1f0-4d61-a10e-cfcddebb781b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d587b9ce-7110-4479-8c98-bcffc59d0421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d587b9ce-7110-4479-8c98-bcffc59d0421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-890415572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec716080-43f3-468a-8532-3604990e30ed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1d3ac79aa174707b10cceac9efa051b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:11Z,use_quota=True,user_id='03a66866de2944669a60acada0293560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ceac425-19c6-498b-8010-b52bc72439ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ceac425-19c6-498b-8010-b52bc72439ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d97dcfc-786d-4767-8f97-3302fcd2028f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d97dcfc-786d-4767-8f97-3302fcd2028f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec716080-43f3-468a-8532-3604990e30ed', 'volume_name': 'volume-ec716080-43f3-468a-8532-3604990e30ed', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f032f241-d6b6-4204-b084-1788f174c721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f032f241-d6b6-4204-b084-1788f174c721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e68666-fe47-45b3-ba70-1b4505f7e0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:11 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Volume ec716080-43f3-468a-8532-3604990e30ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec716080-43f3-468a-8532-3604990e30ed', 'volume_size': 1} Nov 04 18:57:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:11 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-890415572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec716080-43f3-468a-8532-3604990e30ed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1d3ac79aa174707b10cceac9efa051b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:11Z,use_quota=True,user_id='03a66866de2944669a60acada0293560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:57:11 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Creating volume ec716080-43f3-468a-8532-3604990e30ed {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:57:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:11 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:11 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:11 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:57:11 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:57:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ec716080-43f3-468a-8532-3604990e30ed 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:11 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ec716080-43f3-468a-8532-3604990e30ed 1073741824 Nov 04 18:57:11 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:12 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ec716080-43f3-468a-8532-3604990e30ed 1073741824" returned: 0 in 0.691s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ec716080-43f3-468a-8532-3604990e30ed {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:12 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ec716080-43f3-468a-8532-3604990e30ed Nov 04 18:57:12 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:12 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ec716080-43f3-468a-8532-3604990e30ed" returned: 0 in 0.444s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:12 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:57:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:12 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e68666-fe47-45b3-ba70-1b4505f7e0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec716080-43f3-468a-8532-3604990e30ed', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:12 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b5086c7-8577-4ae7-9376-cf1e925abbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:12 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Volume volume-ec716080-43f3-468a-8532-3604990e30ed (ec716080-43f3-468a-8532-3604990e30ed): created successfully Nov 04 18:57:12 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b5086c7-8577-4ae7-9376-cf1e925abbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:12 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Flow 'volume_create_manager' (3eb55fff-e1f0-4d61-a10e-cfcddebb781b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:12 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-f65df5b5-da16-4023-a82c-485d8884943c tempest-VolumesListTestJSON-156550522 None] Created volume successfully. Nov 04 18:57:13 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:57:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Flow 'volume_create_manager' (c1b43986-fd21-44f9-b4a2-3d884e50f7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90cdc668-0ad9-4496-a152-dc36850313ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90cdc668-0ad9-4496-a152-dc36850313ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-543923219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf88f60-6b55-4042-9b4b-70df703be1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952c3d2970cc4af3a66724782faa9cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:13Z,use_quota=True,user_id='4c5e221856804394b414fb8e62998ad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (754b052c-e13c-4528-9894-48a19bc36b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (754b052c-e13c-4528-9894-48a19bc36b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b12cdfd3-70f9-4826-9a58-cf7247d7224c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b12cdfd3-70f9-4826-9a58-cf7247d7224c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bf88f60-6b55-4042-9b4b-70df703be1be', 'volume_name': 'volume-5bf88f60-6b55-4042-9b4b-70df703be1be', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c8d488-b414-485b-b555-ae5bb4ac1e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c8d488-b414-485b-b555-ae5bb4ac1e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7620b245-6181-4bf7-a5e2-251990590a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:13 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Volume 5bf88f60-6b55-4042-9b4b-70df703be1be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bf88f60-6b55-4042-9b4b-70df703be1be', 'volume_size': 1} Nov 04 18:57:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:13 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-543923219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf88f60-6b55-4042-9b4b-70df703be1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952c3d2970cc4af3a66724782faa9cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:13Z,use_quota=True,user_id='4c5e221856804394b414fb8e62998ad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:57:13 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Creating volume 5bf88f60-6b55-4042-9b4b-70df703be1be {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:57:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:13 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:13 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:13 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:57:13 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:57:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5bf88f60-6b55-4042-9b4b-70df703be1be 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:13 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5bf88f60-6b55-4042-9b4b-70df703be1be 1073741824 Nov 04 18:57:13 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Flow 'volume_create_manager' (32f0574f-4458-47b4-948d-a93e1a9813de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96715ac-a0e7-4ca6-b2c1-832a2141131b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:14 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96715ac-a0e7-4ca6-b2c1-832a2141131b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1150030977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc37579b-4d25-488e-9015-649ac24050ec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1d3ac79aa174707b10cceac9efa051b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:14Z,use_quota=True,user_id='03a66866de2944669a60acada0293560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef67da3-7124-4def-9833-2d66d1cff7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef67da3-7124-4def-9833-2d66d1cff7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b0b452b-04d4-481d-91a4-afe2d74ce079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b0b452b-04d4-481d-91a4-afe2d74ce079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc37579b-4d25-488e-9015-649ac24050ec', 'volume_name': 'volume-cc37579b-4d25-488e-9015-649ac24050ec', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d57c696-8703-4d80-ac6f-36e87cd849ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d57c696-8703-4d80-ac6f-36e87cd849ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e77f3ec-6a0c-4180-9733-116d86a9fbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:14 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Volume cc37579b-4d25-488e-9015-649ac24050ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc37579b-4d25-488e-9015-649ac24050ec', 'volume_size': 1} Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5bf88f60-6b55-4042-9b4b-70df703be1be 1073741824" returned: 0 in 0.732s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5bf88f60-6b55-4042-9b4b-70df703be1be {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:14 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5bf88f60-6b55-4042-9b4b-70df703be1be Nov 04 18:57:14 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:14 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5bf88f60-6b55-4042-9b4b-70df703be1be" returned: 0 in 0.268s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.357s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1150030977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc37579b-4d25-488e-9015-649ac24050ec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b1d3ac79aa174707b10cceac9efa051b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:14Z,use_quota=True,user_id='03a66866de2944669a60acada0293560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Creating volume cc37579b-4d25-488e-9015-649ac24050ec {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:57:14 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cc37579b-4d25-488e-9015-649ac24050ec 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7620b245-6181-4bf7-a5e2-251990590a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bf88f60-6b55-4042-9b4b-70df703be1be', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:14 devstack sudo[98285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cc37579b-4d25-488e-9015-649ac24050ec 1073741824 Nov 04 18:57:14 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ebb5ad-7ec4-421a-b1f3-cf4e583e0f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:14 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Volume volume-5bf88f60-6b55-4042-9b4b-70df703be1be (5bf88f60-6b55-4042-9b4b-70df703be1be): created successfully Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ebb5ad-7ec4-421a-b1f3-cf4e583e0f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Flow 'volume_create_manager' (c1b43986-fd21-44f9-b4a2-3d884e50f7e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:14 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-c2e50755-cac3-4d95-910e-03468fe1cff3 tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Created volume successfully. Nov 04 18:57:15 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cc37579b-4d25-488e-9015-649ac24050ec 1073741824" returned: 0 in 0.458s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cc37579b-4d25-488e-9015-649ac24050ec {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:15 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cc37579b-4d25-488e-9015-649ac24050ec Nov 04 18:57:15 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:15 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cc37579b-4d25-488e-9015-649ac24050ec" returned: 0 in 0.461s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:15 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:57:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:15 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e77f3ec-6a0c-4180-9733-116d86a9fbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc37579b-4d25-488e-9015-649ac24050ec', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:15 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab2b47d-8447-4923-ba45-2c8030f32bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:15 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Volume volume-cc37579b-4d25-488e-9015-649ac24050ec (cc37579b-4d25-488e-9015-649ac24050ec): created successfully Nov 04 18:57:15 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab2b47d-8447-4923-ba45-2c8030f32bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:15 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Flow 'volume_create_manager' (32f0574f-4458-47b4-948d-a93e1a9813de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:15 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-7fe154bc-8fe0-4449-9f26-13f18476077d tempest-VolumesListTestJSON-156550522 None] Created volume successfully. Nov 04 18:57:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-d5ef480e-e1cd-4b1c-996d-48e8ff2dec99 req-4a6e0e24-530b-49dc-8aa3-9fc9f409a5ff tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-d5ef480e-e1cd-4b1c-996d-48e8ff2dec99 req-4a6e0e24-530b-49dc-8aa3-9fc9f409a5ff tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-d5ef480e-e1cd-4b1c-996d-48e8ff2dec99 req-4a6e0e24-530b-49dc-8aa3-9fc9f409a5ff tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:16 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-d5ef480e-e1cd-4b1c-996d-48e8ff2dec99 req-4a6e0e24-530b-49dc-8aa3-9fc9f409a5ff tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280', 'name': 'volume-5bf88f60-6b55-4042-9b4b-70df703be1be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '48f03559-b0d9-4e8a-bb5a-18c4580396c7', 'enforce_multipath': True} {{(pid=87119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:57:16 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-d5ef480e-e1cd-4b1c-996d-48e8ff2dec99 req-4a6e0e24-530b-49dc-8aa3-9fc9f409a5ff tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] attachment_update completed successfully. Nov 04 18:57:18 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3bdf224e-1f76-4b1e-8c0f-eb516d5edffc tempest-VolumesListTestJSON-156550522 None] Acquiring lock "cinder-cc37579b-4d25-488e-9015-649ac24050ec-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:18 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3bdf224e-1f76-4b1e-8c0f-eb516d5edffc tempest-VolumesListTestJSON-156550522 None] Lock "cinder-cc37579b-4d25-488e-9015-649ac24050ec-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:18 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=69,cinder:UPDATE=96,cinder:INSERT=21,cinder:DELETE=7 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:57:18 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3bdf224e-1f76-4b1e-8c0f-eb516d5edffc tempest-VolumesListTestJSON-156550522 None] Acquiring lock "cinder-quobyte-cc37579b-4d25-488e-9015-649ac24050ec" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:19 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3bdf224e-1f76-4b1e-8c0f-eb516d5edffc tempest-VolumesListTestJSON-156550522 None] Lock "cinder-quobyte-cc37579b-4d25-488e-9015-649ac24050ec" acquired by "delete_volume" :: waited 0.025s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:19 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d5c5b8-9575-4665-872a-4b8a75273a1f]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3bdf224e-1f76-4b1e-8c0f-eb516d5edffc tempest-VolumesListTestJSON-156550522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cc37579b-4d25-488e-9015-649ac24050ec {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:19 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cc37579b-4d25-488e-9015-649ac24050ec Nov 04 18:57:19 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:19 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3bdf224e-1f76-4b1e-8c0f-eb516d5edffc tempest-VolumesListTestJSON-156550522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cc37579b-4d25-488e-9015-649ac24050ec" returned: 0 in 0.443s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3bdf224e-1f76-4b1e-8c0f-eb516d5edffc tempest-VolumesListTestJSON-156550522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cc37579b-4d25-488e-9015-649ac24050ec {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:19 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cc37579b-4d25-488e-9015-649ac24050ec Nov 04 18:57:19 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:19 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3bdf224e-1f76-4b1e-8c0f-eb516d5edffc tempest-VolumesListTestJSON-156550522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cc37579b-4d25-488e-9015-649ac24050ec" returned: 0 in 0.271s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:19 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3bdf224e-1f76-4b1e-8c0f-eb516d5edffc tempest-VolumesListTestJSON-156550522 None] Lock "cinder-quobyte-cc37579b-4d25-488e-9015-649ac24050ec" released by "delete_volume" :: held 0.773s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:19 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-3bdf224e-1f76-4b1e-8c0f-eb516d5edffc tempest-VolumesListTestJSON-156550522 None] Created reservations ['e57bb5c0-02fe-4e56-9258-0f3ad6e1f388', '78dc12fa-dfc9-4652-bb80-fcfe50488e29', '0c63b45e-0e7b-4e80-8aaf-84ba6239b08f', 'c7c64c87-684a-4ca5-8fd1-55cef13a35cd'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:57:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3bdf224e-1f76-4b1e-8c0f-eb516d5edffc tempest-VolumesListTestJSON-156550522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3bdf224e-1f76-4b1e-8c0f-eb516d5edffc tempest-VolumesListTestJSON-156550522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:19 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3bdf224e-1f76-4b1e-8c0f-eb516d5edffc tempest-VolumesListTestJSON-156550522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:19 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3bdf224e-1f76-4b1e-8c0f-eb516d5edffc tempest-VolumesListTestJSON-156550522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3bdf224e-1f76-4b1e-8c0f-eb516d5edffc tempest-VolumesListTestJSON-156550522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3bdf224e-1f76-4b1e-8c0f-eb516d5edffc tempest-VolumesListTestJSON-156550522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:19 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:57:19 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:20 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3bdf224e-1f76-4b1e-8c0f-eb516d5edffc tempest-VolumesListTestJSON-156550522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.301s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:20 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-3bdf224e-1f76-4b1e-8c0f-eb516d5edffc tempest-VolumesListTestJSON-156550522 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:57:20 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-3bdf224e-1f76-4b1e-8c0f-eb516d5edffc tempest-VolumesListTestJSON-156550522 None] Deleted volume successfully. Nov 04 18:57:20 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c97402a1-cd8a-4963-84ec-d2a0aa4bd645 tempest-VolumesListTestJSON-156550522 None] Acquiring lock "cinder-ec716080-43f3-468a-8532-3604990e30ed-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:20 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3bdf224e-1f76-4b1e-8c0f-eb516d5edffc tempest-VolumesListTestJSON-156550522 None] Lock "cinder-cc37579b-4d25-488e-9015-649ac24050ec-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:20 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c97402a1-cd8a-4963-84ec-d2a0aa4bd645 tempest-VolumesListTestJSON-156550522 None] Lock "cinder-ec716080-43f3-468a-8532-3604990e30ed-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:20 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c97402a1-cd8a-4963-84ec-d2a0aa4bd645 tempest-VolumesListTestJSON-156550522 None] Acquiring lock "cinder-quobyte-ec716080-43f3-468a-8532-3604990e30ed" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:20 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c97402a1-cd8a-4963-84ec-d2a0aa4bd645 tempest-VolumesListTestJSON-156550522 None] Lock "cinder-quobyte-ec716080-43f3-468a-8532-3604990e30ed" acquired by "delete_volume" :: waited 0.020s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:20 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc48541e-15fb-4e3f-aa60-797942878592]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c97402a1-cd8a-4963-84ec-d2a0aa4bd645 tempest-VolumesListTestJSON-156550522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ec716080-43f3-468a-8532-3604990e30ed {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:20 devstack sudo[98346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ec716080-43f3-468a-8532-3604990e30ed Nov 04 18:57:20 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:20 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c97402a1-cd8a-4963-84ec-d2a0aa4bd645 tempest-VolumesListTestJSON-156550522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ec716080-43f3-468a-8532-3604990e30ed" returned: 0 in 0.445s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c97402a1-cd8a-4963-84ec-d2a0aa4bd645 tempest-VolumesListTestJSON-156550522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ec716080-43f3-468a-8532-3604990e30ed {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:20 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ec716080-43f3-468a-8532-3604990e30ed Nov 04 18:57:20 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:21 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:UPDATE=102,cinder:SELECT=83,cinder:DELETE=11,cinder:INSERT=19 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:57:21 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-aa5320a6-256a-4a8f-9575-77805df1558b req-5517eafd-7553-4b7c-b4b8-cc73a910623e tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Terminate volume connection completed successfully. Nov 04 18:57:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-aa5320a6-256a-4a8f-9575-77805df1558b req-5517eafd-7553-4b7c-b4b8-cc73a910623e tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Deleting attachment 48f03559-b0d9-4e8a-bb5a-18c4580396c7. {{(pid=87119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:57:21 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c97402a1-cd8a-4963-84ec-d2a0aa4bd645 tempest-VolumesListTestJSON-156550522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ec716080-43f3-468a-8532-3604990e30ed" returned: 0 in 0.308s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:21 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c97402a1-cd8a-4963-84ec-d2a0aa4bd645 tempest-VolumesListTestJSON-156550522 None] Lock "cinder-quobyte-ec716080-43f3-468a-8532-3604990e30ed" released by "delete_volume" :: held 0.827s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:21 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-c97402a1-cd8a-4963-84ec-d2a0aa4bd645 tempest-VolumesListTestJSON-156550522 None] Created reservations ['ce82249d-4fe3-4607-8200-2d1af2593bf2', 'c10efe5e-4be4-4708-b884-94cc8a5b2a3c', 'c1534ef1-a87f-4bd3-b899-10de5e8653eb', '137f5e3f-ead7-4111-ba6a-d5e9bb5fa674'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:57:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c97402a1-cd8a-4963-84ec-d2a0aa4bd645 tempest-VolumesListTestJSON-156550522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c97402a1-cd8a-4963-84ec-d2a0aa4bd645 tempest-VolumesListTestJSON-156550522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:21 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c97402a1-cd8a-4963-84ec-d2a0aa4bd645 tempest-VolumesListTestJSON-156550522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:21 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c97402a1-cd8a-4963-84ec-d2a0aa4bd645 tempest-VolumesListTestJSON-156550522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c97402a1-cd8a-4963-84ec-d2a0aa4bd645 tempest-VolumesListTestJSON-156550522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c97402a1-cd8a-4963-84ec-d2a0aa4bd645 tempest-VolumesListTestJSON-156550522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:21 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:57:21 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:21 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9c960b7c-5063-4fb4-abf5-da97a18663af tempest-VolumesListTestJSON-156550522 None] Acquiring lock "cinder-6396838f-e005-4280-ad17-53cbc888b02a-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:21 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9c960b7c-5063-4fb4-abf5-da97a18663af tempest-VolumesListTestJSON-156550522 None] Lock "cinder-6396838f-e005-4280-ad17-53cbc888b02a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:21 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c97402a1-cd8a-4963-84ec-d2a0aa4bd645 tempest-VolumesListTestJSON-156550522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.325s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:21 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-c97402a1-cd8a-4963-84ec-d2a0aa4bd645 tempest-VolumesListTestJSON-156550522 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:57:21 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9c960b7c-5063-4fb4-abf5-da97a18663af tempest-VolumesListTestJSON-156550522 None] Acquiring lock "cinder-quobyte-6396838f-e005-4280-ad17-53cbc888b02a" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:21 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-c97402a1-cd8a-4963-84ec-d2a0aa4bd645 tempest-VolumesListTestJSON-156550522 None] Deleted volume successfully. Nov 04 18:57:21 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9c960b7c-5063-4fb4-abf5-da97a18663af tempest-VolumesListTestJSON-156550522 None] Lock "cinder-quobyte-6396838f-e005-4280-ad17-53cbc888b02a" acquired by "delete_volume" :: waited 0.031s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:21 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c97402a1-cd8a-4963-84ec-d2a0aa4bd645 tempest-VolumesListTestJSON-156550522 None] Lock "cinder-ec716080-43f3-468a-8532-3604990e30ed-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:21 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1de83e-b87e-477d-b35d-923578a6a3c4]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9c960b7c-5063-4fb4-abf5-da97a18663af tempest-VolumesListTestJSON-156550522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6396838f-e005-4280-ad17-53cbc888b02a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:21 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5b9b2b8c-6def-4102-9a21-586fa4ae672a tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Acquiring lock "cinder-5bf88f60-6b55-4042-9b4b-70df703be1be-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:21 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5b9b2b8c-6def-4102-9a21-586fa4ae672a tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Lock "cinder-5bf88f60-6b55-4042-9b4b-70df703be1be-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:21 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5b9b2b8c-6def-4102-9a21-586fa4ae672a tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Acquiring lock "cinder-quobyte-5bf88f60-6b55-4042-9b4b-70df703be1be" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:21 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6396838f-e005-4280-ad17-53cbc888b02a Nov 04 18:57:21 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:21 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5b9b2b8c-6def-4102-9a21-586fa4ae672a tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Lock "cinder-quobyte-5bf88f60-6b55-4042-9b4b-70df703be1be" acquired by "delete_volume" :: waited 0.025s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:22 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f436a4-4c8e-4808-9974-b966a54e5906]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5b9b2b8c-6def-4102-9a21-586fa4ae672a tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5bf88f60-6b55-4042-9b4b-70df703be1be {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:22 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5bf88f60-6b55-4042-9b4b-70df703be1be Nov 04 18:57:22 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:22 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9c960b7c-5063-4fb4-abf5-da97a18663af tempest-VolumesListTestJSON-156550522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6396838f-e005-4280-ad17-53cbc888b02a" returned: 0 in 0.478s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9c960b7c-5063-4fb4-abf5-da97a18663af tempest-VolumesListTestJSON-156550522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6396838f-e005-4280-ad17-53cbc888b02a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:22 devstack sudo[98366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6396838f-e005-4280-ad17-53cbc888b02a Nov 04 18:57:22 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:22 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5b9b2b8c-6def-4102-9a21-586fa4ae672a tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5bf88f60-6b55-4042-9b4b-70df703be1be" returned: 0 in 0.442s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5b9b2b8c-6def-4102-9a21-586fa4ae672a tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5bf88f60-6b55-4042-9b4b-70df703be1be {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:22 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5bf88f60-6b55-4042-9b4b-70df703be1be Nov 04 18:57:22 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:22 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9c960b7c-5063-4fb4-abf5-da97a18663af tempest-VolumesListTestJSON-156550522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6396838f-e005-4280-ad17-53cbc888b02a" returned: 0 in 0.278s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:22 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9c960b7c-5063-4fb4-abf5-da97a18663af tempest-VolumesListTestJSON-156550522 None] Lock "cinder-quobyte-6396838f-e005-4280-ad17-53cbc888b02a" released by "delete_volume" :: held 0.834s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:22 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-9c960b7c-5063-4fb4-abf5-da97a18663af tempest-VolumesListTestJSON-156550522 None] Created reservations ['5a468b04-301b-4629-96b2-6eb0a950e61d', 'd58a9194-8ce2-45df-bf29-8540bdca572b', 'f9c11a21-1a8f-4eff-9779-9c96a7ba0ce5', 'e506bc8b-2701-4836-adc4-14b9fef23d0b'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:57:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9c960b7c-5063-4fb4-abf5-da97a18663af tempest-VolumesListTestJSON-156550522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9c960b7c-5063-4fb4-abf5-da97a18663af tempest-VolumesListTestJSON-156550522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:22 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9c960b7c-5063-4fb4-abf5-da97a18663af tempest-VolumesListTestJSON-156550522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:22 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9c960b7c-5063-4fb4-abf5-da97a18663af tempest-VolumesListTestJSON-156550522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9c960b7c-5063-4fb4-abf5-da97a18663af tempest-VolumesListTestJSON-156550522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9c960b7c-5063-4fb4-abf5-da97a18663af tempest-VolumesListTestJSON-156550522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:22 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5b9b2b8c-6def-4102-9a21-586fa4ae672a tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5bf88f60-6b55-4042-9b4b-70df703be1be" returned: 0 in 0.360s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:22 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:57:22 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:22 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5b9b2b8c-6def-4102-9a21-586fa4ae672a tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Lock "cinder-quobyte-5bf88f60-6b55-4042-9b4b-70df703be1be" released by "delete_volume" :: held 0.879s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:22 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-5b9b2b8c-6def-4102-9a21-586fa4ae672a tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Created reservations ['c8d926e1-bfea-44d3-a924-def039914800', '73c1dd56-a6ca-4d01-83ff-9a0e2b5bf022', '93df989b-e9a3-4852-9817-8cfe731a49c6', 'b3138f04-bb48-4a47-b6b7-0c7b568f7ff3'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5b9b2b8c-6def-4102-9a21-586fa4ae672a tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5b9b2b8c-6def-4102-9a21-586fa4ae672a tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5b9b2b8c-6def-4102-9a21-586fa4ae672a tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:23 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5b9b2b8c-6def-4102-9a21-586fa4ae672a tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5b9b2b8c-6def-4102-9a21-586fa4ae672a tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5b9b2b8c-6def-4102-9a21-586fa4ae672a tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9c960b7c-5063-4fb4-abf5-da97a18663af tempest-VolumesListTestJSON-156550522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.397s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-9c960b7c-5063-4fb4-abf5-da97a18663af tempest-VolumesListTestJSON-156550522 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:57:23 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-9c960b7c-5063-4fb4-abf5-da97a18663af tempest-VolumesListTestJSON-156550522 None] Deleted volume successfully. Nov 04 18:57:23 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:57:23 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9c960b7c-5063-4fb4-abf5-da97a18663af tempest-VolumesListTestJSON-156550522 None] Lock "cinder-6396838f-e005-4280-ad17-53cbc888b02a-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:23 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5b9b2b8c-6def-4102-9a21-586fa4ae672a tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.384s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-5b9b2b8c-6def-4102-9a21-586fa4ae672a tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:57:23 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-5b9b2b8c-6def-4102-9a21-586fa4ae672a tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Deleted volume successfully. Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5b9b2b8c-6def-4102-9a21-586fa4ae672a tempest-TestServerVolumeAttachScenarioOldVersion-933500275 None] Lock "cinder-5bf88f60-6b55-4042-9b4b-70df703be1be-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Flow 'volume_create_manager' (ec8a3d5c-631c-4a14-ac10-85c72d735aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5636fe9-faac-4ffd-afa7-059eb6082d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5636fe9-faac-4ffd-afa7-059eb6082d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1804537524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=263d0acf-cb54-4f7a-b5d9-7a7e14e85379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2535839127a8457db34b546cf8559348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:24Z,use_quota=True,user_id='293a43cc74664b6d8172580981c3df0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4762edd3-7a03-4056-ac02-9a0384a73362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4762edd3-7a03-4056-ac02-9a0384a73362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d512da5a-9cff-4afd-a3ed-f9f10b0179fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d512da5a-9cff-4afd-a3ed-f9f10b0179fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '263d0acf-cb54-4f7a-b5d9-7a7e14e85379', 'volume_name': 'volume-263d0acf-cb54-4f7a-b5d9-7a7e14e85379', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2726f040-d253-42a7-a44f-95fc51457d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2726f040-d253-42a7-a44f-95fc51457d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b1a8ff-5f75-4a10-a98a-ffa98c9f2fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:23 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Volume 263d0acf-cb54-4f7a-b5d9-7a7e14e85379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-263d0acf-cb54-4f7a-b5d9-7a7e14e85379', 'volume_size': 1} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1804537524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=263d0acf-cb54-4f7a-b5d9-7a7e14e85379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2535839127a8457db34b546cf8559348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:24Z,use_quota=True,user_id='293a43cc74664b6d8172580981c3df0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Creating volume 263d0acf-cb54-4f7a-b5d9-7a7e14e85379 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:57:23 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:57:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-263d0acf-cb54-4f7a-b5d9-7a7e14e85379 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:23 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-263d0acf-cb54-4f7a-b5d9-7a7e14e85379 1073741824 Nov 04 18:57:23 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:24 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-263d0acf-cb54-4f7a-b5d9-7a7e14e85379 1073741824" returned: 0 in 0.657s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-263d0acf-cb54-4f7a-b5d9-7a7e14e85379 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:24 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-263d0acf-cb54-4f7a-b5d9-7a7e14e85379 Nov 04 18:57:24 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:25 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-263d0acf-cb54-4f7a-b5d9-7a7e14e85379" returned: 0 in 0.574s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:57:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b1a8ff-5f75-4a10-a98a-ffa98c9f2fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-263d0acf-cb54-4f7a-b5d9-7a7e14e85379', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619d8b71-6ce3-4e6f-8071-f4bf27e6b028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:25 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Volume volume-263d0acf-cb54-4f7a-b5d9-7a7e14e85379 (263d0acf-cb54-4f7a-b5d9-7a7e14e85379): created successfully Nov 04 18:57:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619d8b71-6ce3-4e6f-8071-f4bf27e6b028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Flow 'volume_create_manager' (ec8a3d5c-631c-4a14-ac10-85c72d735aed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:57:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:25 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-8df68255-8581-4139-b9d1-4348fff03ec2 tempest-VolumesListAdminTestJSON-484794847 None] Created volume successfully. Nov 04 18:57:25 devstack sudo[98412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:57:25 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:25 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.383s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:25 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:57:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager._thread_info {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:57:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread count: 28 {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:57:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread info: [<_MainThread(MainThread, started 130247852032128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:57:26 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:57:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Flow 'volume_create_manager' (dfc16e9d-2843-4589-a429-b6abed629e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc4107a1-416e-45cc-aaea-b8eb62155eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc4107a1-416e-45cc-aaea-b8eb62155eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-868436036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d61146ae-9d82-4413-8d50-e5eeaa1300de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2535839127a8457db34b546cf8559348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:26Z,use_quota=True,user_id='293a43cc74664b6d8172580981c3df0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2cee554-291e-4d09-a738-6a2e310d0851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2cee554-291e-4d09-a738-6a2e310d0851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a05d2961-5964-4ece-bf53-42785be8ccf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a05d2961-5964-4ece-bf53-42785be8ccf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd61146ae-9d82-4413-8d50-e5eeaa1300de', 'volume_name': 'volume-d61146ae-9d82-4413-8d50-e5eeaa1300de', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da586a7-3ca9-4203-9c48-6d4423f7d10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da586a7-3ca9-4203-9c48-6d4423f7d10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5305a4d1-8a7e-41a9-84df-fea7eaf4c6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:26 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Volume d61146ae-9d82-4413-8d50-e5eeaa1300de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d61146ae-9d82-4413-8d50-e5eeaa1300de', 'volume_size': 1} Nov 04 18:57:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-868436036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d61146ae-9d82-4413-8d50-e5eeaa1300de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2535839127a8457db34b546cf8559348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:26Z,use_quota=True,user_id='293a43cc74664b6d8172580981c3df0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:57:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Creating volume d61146ae-9d82-4413-8d50-e5eeaa1300de {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:57:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:57:26 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:57:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d61146ae-9d82-4413-8d50-e5eeaa1300de 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:26 devstack sudo[98418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d61146ae-9d82-4413-8d50-e5eeaa1300de 1073741824 Nov 04 18:57:26 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:27 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d61146ae-9d82-4413-8d50-e5eeaa1300de 1073741824" returned: 0 in 0.488s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d61146ae-9d82-4413-8d50-e5eeaa1300de {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:27 devstack sudo[98425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d61146ae-9d82-4413-8d50-e5eeaa1300de Nov 04 18:57:27 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:27 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d61146ae-9d82-4413-8d50-e5eeaa1300de" returned: 0 in 0.294s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:27 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:57:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5305a4d1-8a7e-41a9-84df-fea7eaf4c6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d61146ae-9d82-4413-8d50-e5eeaa1300de', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f029324-d390-437b-aad1-a5fe5f36bff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:27 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Volume volume-d61146ae-9d82-4413-8d50-e5eeaa1300de (d61146ae-9d82-4413-8d50-e5eeaa1300de): created successfully Nov 04 18:57:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f029324-d390-437b-aad1-a5fe5f36bff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Flow 'volume_create_manager' (dfc16e9d-2843-4589-a429-b6abed629e98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:27 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-b6962af4-eaf4-4c30-a0af-cfe49ec6ae4d tempest-VolumesListAdminTestJSON-484794847 None] Created volume successfully. Nov 04 18:57:28 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:57:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Flow 'volume_create_manager' (5ff5bad2-2ecc-47ca-b9a2-b7b436bb5572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a4cdf6-5a2b-4ff6-946a-af9aaa45c1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a4cdf6-5a2b-4ff6-946a-af9aaa45c1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1269401322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcee304e-27e8-4bbc-989f-e61458d58d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='836895b723244785a7fb3846ba929dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:28Z,use_quota=True,user_id='3c74f499361d47399696d37f6acb25fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05259594-774a-4621-b000-0bbcf37f3613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05259594-774a-4621-b000-0bbcf37f3613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26547538-db95-4389-9de3-d8ddd449d4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26547538-db95-4389-9de3-d8ddd449d4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcee304e-27e8-4bbc-989f-e61458d58d54', 'volume_name': 'volume-dcee304e-27e8-4bbc-989f-e61458d58d54', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96662bec-2d21-42ce-a245-0687ca0ac490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96662bec-2d21-42ce-a245-0687ca0ac490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd684183-fd3b-4198-94dc-c7cb8efa2b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:28 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Volume dcee304e-27e8-4bbc-989f-e61458d58d54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcee304e-27e8-4bbc-989f-e61458d58d54', 'volume_size': 1} Nov 04 18:57:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1269401322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcee304e-27e8-4bbc-989f-e61458d58d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='836895b723244785a7fb3846ba929dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:28Z,use_quota=True,user_id='3c74f499361d47399696d37f6acb25fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:57:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Creating volume dcee304e-27e8-4bbc-989f-e61458d58d54 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:57:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:57:28 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:57:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:28 devstack sudo[98431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54 1073741824 Nov 04 18:57:28 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:29 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54 1073741824" returned: 0 in 0.679s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:29 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54 Nov 04 18:57:29 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:29 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Flow 'volume_create_manager' (659e0b8c-ff1c-4c8e-9f82-58e6b7d0e619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1fc3809-1651-41f9-bf58-bbc51591da6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54" returned: 0 in 0.466s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1fc3809-1651-41f9-bf58-bbc51591da6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-180585071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=008975cc-932c-40d1-a3e4-dd5ca5d06d6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2535839127a8457db34b546cf8559348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:29Z,use_quota=True,user_id='293a43cc74664b6d8172580981c3df0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ada278a-9f22-4f0c-8e12-f673f4fffb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ada278a-9f22-4f0c-8e12-f673f4fffb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ad5a2f-3445-49d2-8ff4-8c7a71167afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ad5a2f-3445-49d2-8ff4-8c7a71167afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '008975cc-932c-40d1-a3e4-dd5ca5d06d6b', 'volume_name': 'volume-008975cc-932c-40d1-a3e4-dd5ca5d06d6b', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12a0a43-7874-4c05-9458-41b950781dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12a0a43-7874-4c05-9458-41b950781dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aec44a2-a9e6-4e1e-b5d1-f1515b9c1f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:29 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Volume 008975cc-932c-40d1-a3e4-dd5ca5d06d6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-008975cc-932c-40d1-a3e4-dd5ca5d06d6b', 'volume_size': 1} Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-180585071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=008975cc-932c-40d1-a3e4-dd5ca5d06d6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2535839127a8457db34b546cf8559348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:29Z,use_quota=True,user_id='293a43cc74664b6d8172580981c3df0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Creating volume 008975cc-932c-40d1-a3e4-dd5ca5d06d6b {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:57:29 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-008975cc-932c-40d1-a3e4-dd5ca5d06d6b 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd684183-fd3b-4198-94dc-c7cb8efa2b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcee304e-27e8-4bbc-989f-e61458d58d54', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd32f0f-7296-48e6-b0b1-6174903b0be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:29 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-008975cc-932c-40d1-a3e4-dd5ca5d06d6b 1073741824 Nov 04 18:57:29 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:29 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Volume volume-dcee304e-27e8-4bbc-989f-e61458d58d54 (dcee304e-27e8-4bbc-989f-e61458d58d54): created successfully Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd32f0f-7296-48e6-b0b1-6174903b0be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Flow 'volume_create_manager' (5ff5bad2-2ecc-47ca-b9a2-b7b436bb5572) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:29 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-8d7c03cb-9d30-4bf7-bb2c-c4c7800ce2d1 tempest-VolumesSnapshotListTestJSON-1407880182 None] Created volume successfully. Nov 04 18:57:30 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-008975cc-932c-40d1-a3e4-dd5ca5d06d6b 1073741824" returned: 0 in 0.533s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-008975cc-932c-40d1-a3e4-dd5ca5d06d6b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:30 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-008975cc-932c-40d1-a3e4-dd5ca5d06d6b Nov 04 18:57:30 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:30 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-008975cc-932c-40d1-a3e4-dd5ca5d06d6b" returned: 0 in 0.370s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:30 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:57:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aec44a2-a9e6-4e1e-b5d1-f1515b9c1f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-008975cc-932c-40d1-a3e4-dd5ca5d06d6b', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (290d5595-7838-4acf-8407-3cc321ec44d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:30 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Volume volume-008975cc-932c-40d1-a3e4-dd5ca5d06d6b (008975cc-932c-40d1-a3e4-dd5ca5d06d6b): created successfully Nov 04 18:57:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (290d5595-7838-4acf-8407-3cc321ec44d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Flow 'volume_create_manager' (659e0b8c-ff1c-4c8e-9f82-58e6b7d0e619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:30 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-35480c6f-f61b-476d-8ea7-ad9128730d2c tempest-VolumesListAdminTestJSON-484794847 None] Created volume successfully. Nov 04 18:57:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-12634e00-ecfd-4652-8cd2-3cf3d65c7908 tempest-VolumesSnapshotListTestJSON-1407880182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-12634e00-ecfd-4652-8cd2-3cf3d65c7908 tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:30 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-12634e00-ecfd-4652-8cd2-3cf3d65c7908 tempest-VolumesSnapshotListTestJSON-1407880182 None] Creating offline snapshot b5031cf4-c1ce-4e72-93c0-82b41c8ff486 of volume dcee304e-27e8-4bbc-989f-e61458d58d54 {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:57:30 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c7ba57-7723-44d4-80b3-81d05143ead6]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-12634e00-ecfd-4652-8cd2-3cf3d65c7908 tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:30 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54 Nov 04 18:57:30 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:31 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-12634e00-ecfd-4652-8cd2-3cf3d65c7908 tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54" returned: 0 in 0.431s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-12634e00-ecfd-4652-8cd2-3cf3d65c7908 tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:31 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486 1G Nov 04 18:57:31 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:31 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-12634e00-ecfd-4652-8cd2-3cf3d65c7908 tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486 1G" returned: 0 in 0.546s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-12634e00-ecfd-4652-8cd2-3cf3d65c7908 tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcee304e-27e8-4bbc-989f-e61458d58d54 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:31 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcee304e-27e8-4bbc-989f-e61458d58d54 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486 Nov 04 18:57:31 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:32 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-12634e00-ecfd-4652-8cd2-3cf3d65c7908 tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcee304e-27e8-4bbc-989f-e61458d58d54 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486" returned: 0 in 0.311s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:32 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-12634e00-ecfd-4652-8cd2-3cf3d65c7908 tempest-VolumesSnapshotListTestJSON-1407880182 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486 is being set with open permissions: ugo+rw Nov 04 18:57:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-12634e00-ecfd-4652-8cd2-3cf3d65c7908 tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:32 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486 Nov 04 18:57:32 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:32 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-12634e00-ecfd-4652-8cd2-3cf3d65c7908 tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486" returned: 0 in 0.336s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:32 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:57:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Flow 'volume_create_manager' (5e5d4bc0-e8ed-4ffa-84fb-e7812585e6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b0ebd4f-b6a3-4e2c-a598-48ec27d5f73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b0ebd4f-b6a3-4e2c-a598-48ec27d5f73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6440df64-4641-47f3-ae90-0be8f013d99b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bb64952ab0d4c6887e151e7a852ed85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:32Z,use_quota=True,user_id='ad74d889a46842d88423b9a5b5cf6323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40e5b99-d56f-4e8a-95e7-caed361ba396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40e5b99-d56f-4e8a-95e7-caed361ba396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f95577d1-f708-4ccb-992a-611ea8526a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f95577d1-f708-4ccb-992a-611ea8526a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6440df64-4641-47f3-ae90-0be8f013d99b', 'volume_name': 'volume-6440df64-4641-47f3-ae90-0be8f013d99b', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ec3ea7-95b1-4ba4-b1c4-5017522c6745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ec3ea7-95b1-4ba4-b1c4-5017522c6745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae99102d-3a4b-4d8d-9bd0-9f8a08253d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:32 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Volume 6440df64-4641-47f3-ae90-0be8f013d99b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6440df64-4641-47f3-ae90-0be8f013d99b', 'volume_size': 1} Nov 04 18:57:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-12634e00-ecfd-4652-8cd2-3cf3d65c7908 tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:32 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.info Nov 04 18:57:32 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:32 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-12634e00-ecfd-4652-8cd2-3cf3d65c7908 tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.info" returned: 0 in 0.289s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:32 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-12634e00-ecfd-4652-8cd2-3cf3d65c7908 tempest-VolumesSnapshotListTestJSON-1407880182 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.info is being set with open permissions: ugo+rw Nov 04 18:57:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-12634e00-ecfd-4652-8cd2-3cf3d65c7908 tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:32 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.info Nov 04 18:57:32 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:33 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-12634e00-ecfd-4652-8cd2-3cf3d65c7908 tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.info" returned: 0 in 0.302s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-12634e00-ecfd-4652-8cd2-3cf3d65c7908 tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.439s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.625s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6440df64-4641-47f3-ae90-0be8f013d99b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bb64952ab0d4c6887e151e7a852ed85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:32Z,use_quota=True,user_id='ad74d889a46842d88423b9a5b5cf6323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:57:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Creating volume 6440df64-4641-47f3-ae90-0be8f013d99b {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:57:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:57:33 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:57:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6440df64-4641-47f3-ae90-0be8f013d99b 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:33 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6440df64-4641-47f3-ae90-0be8f013d99b 1073741824 Nov 04 18:57:33 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:33 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-12634e00-ecfd-4652-8cd2-3cf3d65c7908 tempest-VolumesSnapshotListTestJSON-1407880182 None] Create snapshot completed successfully Nov 04 18:57:33 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6440df64-4641-47f3-ae90-0be8f013d99b 1073741824" returned: 0 in 0.614s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6440df64-4641-47f3-ae90-0be8f013d99b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:33 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6440df64-4641-47f3-ae90-0be8f013d99b Nov 04 18:57:33 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:34 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-9ea908bb-390d-42d1-bcfc-556155cb5da2 req-894336c0-36cc-47eb-bd78-8bc555706fb7 tempest-AttachVolumeNegativeTest-722614164 None] Terminate volume connection completed successfully. Nov 04 18:57:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-9ea908bb-390d-42d1-bcfc-556155cb5da2 req-894336c0-36cc-47eb-bd78-8bc555706fb7 tempest-AttachVolumeNegativeTest-722614164 None] Deleting attachment 6a1fda91-4032-419a-9b60-5d07c3e384a1. {{(pid=87119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:57:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7d9ca5f6-9d7e-4841-8675-fbcdabd829e6 tempest-VolumesSnapshotListTestJSON-1407880182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:34 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6440df64-4641-47f3-ae90-0be8f013d99b" returned: 0 in 0.393s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:57:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7d9ca5f6-9d7e-4841-8675-fbcdabd829e6 tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.122s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae99102d-3a4b-4d8d-9bd0-9f8a08253d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6440df64-4641-47f3-ae90-0be8f013d99b', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8874dcc1-d193-4dcf-bf49-64a5f78dc670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-7d9ca5f6-9d7e-4841-8675-fbcdabd829e6 tempest-VolumesSnapshotListTestJSON-1407880182 None] Creating offline snapshot c6b143d9-ead9-49b4-b161-207bf627d11f of volume dcee304e-27e8-4bbc-989f-e61458d58d54 {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:57:34 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Volume volume-6440df64-4641-47f3-ae90-0be8f013d99b (6440df64-4641-47f3-ae90-0be8f013d99b): created successfully Nov 04 18:57:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8874dcc1-d193-4dcf-bf49-64a5f78dc670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Flow 'volume_create_manager' (5e5d4bc0-e8ed-4ffa-84fb-e7812585e6b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:34 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a13554-42d9-4362-bb6d-acca6892b150]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7d9ca5f6-9d7e-4841-8675-fbcdabd829e6 tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:34 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e4efabb8-4927-4e02-a1eb-424c88069fc6 tempest-VolumesListAdminTestJSON-1501626111 None] Created volume successfully. Nov 04 18:57:34 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486 Nov 04 18:57:34 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:34 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-60462647-74b8-45da-b943-d217ed326c2b tempest-VolumesListAdminTestJSON-1501626111 None] Acquiring lock "cinder-6440df64-4641-47f3-ae90-0be8f013d99b-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:34 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-60462647-74b8-45da-b943-d217ed326c2b tempest-VolumesListAdminTestJSON-1501626111 None] Lock "cinder-6440df64-4641-47f3-ae90-0be8f013d99b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:34 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-60462647-74b8-45da-b943-d217ed326c2b tempest-VolumesListAdminTestJSON-1501626111 None] Acquiring lock "cinder-quobyte-6440df64-4641-47f3-ae90-0be8f013d99b" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:34 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-60462647-74b8-45da-b943-d217ed326c2b tempest-VolumesListAdminTestJSON-1501626111 None] Lock "cinder-quobyte-6440df64-4641-47f3-ae90-0be8f013d99b" acquired by "delete_volume" :: waited 0.038s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:34 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef0f168-43bc-4031-b26f-e32199e237f5]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-60462647-74b8-45da-b943-d217ed326c2b tempest-VolumesListAdminTestJSON-1501626111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6440df64-4641-47f3-ae90-0be8f013d99b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:34 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0a26a1b4-150c-4664-bec3-bda8d114718d tempest-VolumesListAdminTestJSON-484794847 None] Acquiring lock "cinder-008975cc-932c-40d1-a3e4-dd5ca5d06d6b-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:34 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0a26a1b4-150c-4664-bec3-bda8d114718d tempest-VolumesListAdminTestJSON-484794847 None] Lock "cinder-008975cc-932c-40d1-a3e4-dd5ca5d06d6b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:34 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0a26a1b4-150c-4664-bec3-bda8d114718d tempest-VolumesListAdminTestJSON-484794847 None] Acquiring lock "cinder-quobyte-008975cc-932c-40d1-a3e4-dd5ca5d06d6b" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:34 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7d9ca5f6-9d7e-4841-8675-fbcdabd829e6 tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486" returned: 0 in 0.542s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-7d9ca5f6-9d7e-4841-8675-fbcdabd829e6 tempest-VolumesSnapshotListTestJSON-1407880182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcee304e-27e8-4bbc-989f-e61458d58d54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:57:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7d9ca5f6-9d7e-4841-8675-fbcdabd829e6 tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:34 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6440df64-4641-47f3-ae90-0be8f013d99b Nov 04 18:57:34 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:34 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0a26a1b4-150c-4664-bec3-bda8d114718d tempest-VolumesListAdminTestJSON-484794847 None] Lock "cinder-quobyte-008975cc-932c-40d1-a3e4-dd5ca5d06d6b" acquired by "delete_volume" :: waited 0.048s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:34 devstack sudo[98521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f 1G Nov 04 18:57:34 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:35 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce8a04a-23b6-4edc-86a0-f389da18eacc]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0a26a1b4-150c-4664-bec3-bda8d114718d tempest-VolumesListAdminTestJSON-484794847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-008975cc-932c-40d1-a3e4-dd5ca5d06d6b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:35 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-008975cc-932c-40d1-a3e4-dd5ca5d06d6b Nov 04 18:57:35 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:35 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-60462647-74b8-45da-b943-d217ed326c2b tempest-VolumesListAdminTestJSON-1501626111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6440df64-4641-47f3-ae90-0be8f013d99b" returned: 0 in 0.725s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-60462647-74b8-45da-b943-d217ed326c2b tempest-VolumesListAdminTestJSON-1501626111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6440df64-4641-47f3-ae90-0be8f013d99b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:35 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6440df64-4641-47f3-ae90-0be8f013d99b Nov 04 18:57:35 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:35 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0a26a1b4-150c-4664-bec3-bda8d114718d tempest-VolumesListAdminTestJSON-484794847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-008975cc-932c-40d1-a3e4-dd5ca5d06d6b" returned: 0 in 0.813s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0a26a1b4-150c-4664-bec3-bda8d114718d tempest-VolumesListAdminTestJSON-484794847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-008975cc-932c-40d1-a3e4-dd5ca5d06d6b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:35 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-008975cc-932c-40d1-a3e4-dd5ca5d06d6b Nov 04 18:57:35 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:35 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7d9ca5f6-9d7e-4841-8675-fbcdabd829e6 tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f 1G" returned: 0 in 0.965s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7d9ca5f6-9d7e-4841-8675-fbcdabd829e6 tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:35 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f Nov 04 18:57:35 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:36 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-60462647-74b8-45da-b943-d217ed326c2b tempest-VolumesListAdminTestJSON-1501626111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6440df64-4641-47f3-ae90-0be8f013d99b" returned: 0 in 0.525s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:36 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-60462647-74b8-45da-b943-d217ed326c2b tempest-VolumesListAdminTestJSON-1501626111 None] Lock "cinder-quobyte-6440df64-4641-47f3-ae90-0be8f013d99b" released by "delete_volume" :: held 1.322s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:36 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-60462647-74b8-45da-b943-d217ed326c2b tempest-VolumesListAdminTestJSON-1501626111 None] Created reservations ['a4838998-eab4-46d1-8e2b-90e2b739f06c', 'bd8fa426-9e4a-46fe-85cc-e6fbed75b733', 'fe644f07-d680-48b0-a2c1-e2efb35c5970', 'bb141622-78ae-49dd-940d-e0ab86d4eb7a'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:57:36 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0a26a1b4-150c-4664-bec3-bda8d114718d tempest-VolumesListAdminTestJSON-484794847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-008975cc-932c-40d1-a3e4-dd5ca5d06d6b" returned: 0 in 0.385s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:36 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0a26a1b4-150c-4664-bec3-bda8d114718d tempest-VolumesListAdminTestJSON-484794847 None] Lock "cinder-quobyte-008975cc-932c-40d1-a3e4-dd5ca5d06d6b" released by "delete_volume" :: held 1.276s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-60462647-74b8-45da-b943-d217ed326c2b tempest-VolumesListAdminTestJSON-1501626111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-60462647-74b8-45da-b943-d217ed326c2b tempest-VolumesListAdminTestJSON-1501626111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:36 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-60462647-74b8-45da-b943-d217ed326c2b tempest-VolumesListAdminTestJSON-1501626111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:36 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-60462647-74b8-45da-b943-d217ed326c2b tempest-VolumesListAdminTestJSON-1501626111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-60462647-74b8-45da-b943-d217ed326c2b tempest-VolumesListAdminTestJSON-1501626111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-60462647-74b8-45da-b943-d217ed326c2b tempest-VolumesListAdminTestJSON-1501626111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:36 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:57:36 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:36 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7d9ca5f6-9d7e-4841-8675-fbcdabd829e6 tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f" returned: 0 in 0.499s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:36 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-7d9ca5f6-9d7e-4841-8675-fbcdabd829e6 tempest-VolumesSnapshotListTestJSON-1407880182 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f is being set with open permissions: ugo+rw Nov 04 18:57:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7d9ca5f6-9d7e-4841-8675-fbcdabd829e6 tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:36 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-0a26a1b4-150c-4664-bec3-bda8d114718d tempest-VolumesListAdminTestJSON-484794847 None] Created reservations ['e94dbd09-7eda-4db6-b36f-71608ad8cc79', '44ecf30a-8acd-4265-9045-2088ed4f1e55', '129ef065-523d-4571-807a-ded647f19ed0', '78faa975-3bf0-489a-941c-cd481d7797b3'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:57:36 devstack sudo[98577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f Nov 04 18:57:36 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0a26a1b4-150c-4664-bec3-bda8d114718d tempest-VolumesListAdminTestJSON-484794847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0a26a1b4-150c-4664-bec3-bda8d114718d tempest-VolumesListAdminTestJSON-484794847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:36 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0a26a1b4-150c-4664-bec3-bda8d114718d tempest-VolumesListAdminTestJSON-484794847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:36 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0a26a1b4-150c-4664-bec3-bda8d114718d tempest-VolumesListAdminTestJSON-484794847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0a26a1b4-150c-4664-bec3-bda8d114718d tempest-VolumesListAdminTestJSON-484794847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0a26a1b4-150c-4664-bec3-bda8d114718d tempest-VolumesListAdminTestJSON-484794847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:36 devstack sudo[98579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:57:36 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:36 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-60462647-74b8-45da-b943-d217ed326c2b tempest-VolumesListAdminTestJSON-1501626111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.441s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:36 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-60462647-74b8-45da-b943-d217ed326c2b tempest-VolumesListAdminTestJSON-1501626111 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:57:36 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-60462647-74b8-45da-b943-d217ed326c2b tempest-VolumesListAdminTestJSON-1501626111 None] Deleted volume successfully. Nov 04 18:57:36 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7d9ca5f6-9d7e-4841-8675-fbcdabd829e6 tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f" returned: 0 in 0.352s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7d9ca5f6-9d7e-4841-8675-fbcdabd829e6 tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.507s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:36 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-60462647-74b8-45da-b943-d217ed326c2b tempest-VolumesListAdminTestJSON-1501626111 None] Lock "cinder-6440df64-4641-47f3-ae90-0be8f013d99b-delete_volume" released by "delete_volume" :: held 2.218s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:36 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-7d9ca5f6-9d7e-4841-8675-fbcdabd829e6 tempest-VolumesSnapshotListTestJSON-1407880182 None] Create snapshot completed successfully Nov 04 18:57:36 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0a26a1b4-150c-4664-bec3-bda8d114718d tempest-VolumesListAdminTestJSON-484794847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.403s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:36 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-0a26a1b4-150c-4664-bec3-bda8d114718d tempest-VolumesListAdminTestJSON-484794847 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:57:36 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-0a26a1b4-150c-4664-bec3-bda8d114718d tempest-VolumesListAdminTestJSON-484794847 None] Deleted volume successfully. Nov 04 18:57:37 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0a26a1b4-150c-4664-bec3-bda8d114718d tempest-VolumesListAdminTestJSON-484794847 None] Lock "cinder-008975cc-932c-40d1-a3e4-dd5ca5d06d6b-delete_volume" released by "delete_volume" :: held 2.162s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:37 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c1ea7ae4-a229-478d-bdad-bd2b9248f7b0 tempest-VolumesListAdminTestJSON-484794847 None] Acquiring lock "cinder-d61146ae-9d82-4413-8d50-e5eeaa1300de-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:37 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c1ea7ae4-a229-478d-bdad-bd2b9248f7b0 tempest-VolumesListAdminTestJSON-484794847 None] Lock "cinder-d61146ae-9d82-4413-8d50-e5eeaa1300de-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:37 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c1ea7ae4-a229-478d-bdad-bd2b9248f7b0 tempest-VolumesListAdminTestJSON-484794847 None] Acquiring lock "cinder-quobyte-d61146ae-9d82-4413-8d50-e5eeaa1300de" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:37 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c1ea7ae4-a229-478d-bdad-bd2b9248f7b0 tempest-VolumesListAdminTestJSON-484794847 None] Lock "cinder-quobyte-d61146ae-9d82-4413-8d50-e5eeaa1300de" acquired by "delete_volume" :: waited 0.017s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:37 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[354d1d58-18e1-4394-9602-7bcf05569352]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c1ea7ae4-a229-478d-bdad-bd2b9248f7b0 tempest-VolumesListAdminTestJSON-484794847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d61146ae-9d82-4413-8d50-e5eeaa1300de {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:37 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d61146ae-9d82-4413-8d50-e5eeaa1300de Nov 04 18:57:37 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-80c3e692-915f-4362-b95a-b69595cbbce3 tempest-VolumesSnapshotListTestJSON-1407880182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-80c3e692-915f-4362-b95a-b69595cbbce3 tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-80c3e692-915f-4362-b95a-b69595cbbce3 tempest-VolumesSnapshotListTestJSON-1407880182 None] Creating offline snapshot 1b81d19d-e91d-4d19-bd53-c30607e20825 of volume dcee304e-27e8-4bbc-989f-e61458d58d54 {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:57:37 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[817f783a-a0bb-415d-919b-1bd9d4e89e3c]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-80c3e692-915f-4362-b95a-b69595cbbce3 tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:37 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f Nov 04 18:57:37 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:37 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c1ea7ae4-a229-478d-bdad-bd2b9248f7b0 tempest-VolumesListAdminTestJSON-484794847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d61146ae-9d82-4413-8d50-e5eeaa1300de" returned: 0 in 0.518s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c1ea7ae4-a229-478d-bdad-bd2b9248f7b0 tempest-VolumesListAdminTestJSON-484794847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d61146ae-9d82-4413-8d50-e5eeaa1300de {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:37 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d61146ae-9d82-4413-8d50-e5eeaa1300de Nov 04 18:57:37 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:38 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-80c3e692-915f-4362-b95a-b69595cbbce3 tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f" returned: 0 in 0.431s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-80c3e692-915f-4362-b95a-b69595cbbce3 tempest-VolumesSnapshotListTestJSON-1407880182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcee304e-27e8-4bbc-989f-e61458d58d54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:57:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-80c3e692-915f-4362-b95a-b69595cbbce3 tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.1b81d19d-e91d-4d19-bd53-c30607e20825 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:38 devstack sudo[98601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.1b81d19d-e91d-4d19-bd53-c30607e20825 1G Nov 04 18:57:38 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:38 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c1ea7ae4-a229-478d-bdad-bd2b9248f7b0 tempest-VolumesListAdminTestJSON-484794847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d61146ae-9d82-4413-8d50-e5eeaa1300de" returned: 0 in 0.283s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c1ea7ae4-a229-478d-bdad-bd2b9248f7b0 tempest-VolumesListAdminTestJSON-484794847 None] Lock "cinder-quobyte-d61146ae-9d82-4413-8d50-e5eeaa1300de" released by "delete_volume" :: held 0.858s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:38 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-c1ea7ae4-a229-478d-bdad-bd2b9248f7b0 tempest-VolumesListAdminTestJSON-484794847 None] Created reservations ['6d084271-d724-49ca-8d3c-4b42abda8b22', '9fc47d35-8c76-4273-a624-90ac7eba951e', '32bc6924-3b2b-402d-bb92-68862fd4d0a3', '0a6c60f0-80b1-4dd2-ad4a-da5900c65c11'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:57:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c1ea7ae4-a229-478d-bdad-bd2b9248f7b0 tempest-VolumesListAdminTestJSON-484794847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c1ea7ae4-a229-478d-bdad-bd2b9248f7b0 tempest-VolumesListAdminTestJSON-484794847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c1ea7ae4-a229-478d-bdad-bd2b9248f7b0 tempest-VolumesListAdminTestJSON-484794847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c1ea7ae4-a229-478d-bdad-bd2b9248f7b0 tempest-VolumesListAdminTestJSON-484794847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c1ea7ae4-a229-478d-bdad-bd2b9248f7b0 tempest-VolumesListAdminTestJSON-484794847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c1ea7ae4-a229-478d-bdad-bd2b9248f7b0 tempest-VolumesListAdminTestJSON-484794847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:38 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:57:38 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-beb972e5-11ef-4be5-9154-59928750b4d3 tempest-VolumesListAdminTestJSON-484794847 None] Acquiring lock "cinder-263d0acf-cb54-4f7a-b5d9-7a7e14e85379-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-beb972e5-11ef-4be5-9154-59928750b4d3 tempest-VolumesListAdminTestJSON-484794847 None] Lock "cinder-263d0acf-cb54-4f7a-b5d9-7a7e14e85379-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-beb972e5-11ef-4be5-9154-59928750b4d3 tempest-VolumesListAdminTestJSON-484794847 None] Acquiring lock "cinder-quobyte-263d0acf-cb54-4f7a-b5d9-7a7e14e85379" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-beb972e5-11ef-4be5-9154-59928750b4d3 tempest-VolumesListAdminTestJSON-484794847 None] Lock "cinder-quobyte-263d0acf-cb54-4f7a-b5d9-7a7e14e85379" acquired by "delete_volume" :: waited 0.027s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:38 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c1ea7ae4-a229-478d-bdad-bd2b9248f7b0 tempest-VolumesListAdminTestJSON-484794847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.489s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:38 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-c1ea7ae4-a229-478d-bdad-bd2b9248f7b0 tempest-VolumesListAdminTestJSON-484794847 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:57:38 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-c1ea7ae4-a229-478d-bdad-bd2b9248f7b0 tempest-VolumesListAdminTestJSON-484794847 None] Deleted volume successfully. Nov 04 18:57:38 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[833acaf0-624d-48a5-abc9-0af26883c695]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-beb972e5-11ef-4be5-9154-59928750b4d3 tempest-VolumesListAdminTestJSON-484794847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-263d0acf-cb54-4f7a-b5d9-7a7e14e85379 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c1ea7ae4-a229-478d-bdad-bd2b9248f7b0 tempest-VolumesListAdminTestJSON-484794847 None] Lock "cinder-d61146ae-9d82-4413-8d50-e5eeaa1300de-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:39 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-80c3e692-915f-4362-b95a-b69595cbbce3 tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.1b81d19d-e91d-4d19-bd53-c30607e20825 1G" returned: 0 in 0.909s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-80c3e692-915f-4362-b95a-b69595cbbce3 tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.1b81d19d-e91d-4d19-bd53-c30607e20825 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:39 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.1b81d19d-e91d-4d19-bd53-c30607e20825 Nov 04 18:57:39 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:39 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-263d0acf-cb54-4f7a-b5d9-7a7e14e85379 Nov 04 18:57:39 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:39 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-80c3e692-915f-4362-b95a-b69595cbbce3 tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.1b81d19d-e91d-4d19-bd53-c30607e20825" returned: 0 in 0.378s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:39 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-80c3e692-915f-4362-b95a-b69595cbbce3 tempest-VolumesSnapshotListTestJSON-1407880182 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.1b81d19d-e91d-4d19-bd53-c30607e20825 is being set with open permissions: ugo+rw Nov 04 18:57:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-80c3e692-915f-4362-b95a-b69595cbbce3 tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.1b81d19d-e91d-4d19-bd53-c30607e20825 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:39 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.1b81d19d-e91d-4d19-bd53-c30607e20825 Nov 04 18:57:39 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:39 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-beb972e5-11ef-4be5-9154-59928750b4d3 tempest-VolumesListAdminTestJSON-484794847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-263d0acf-cb54-4f7a-b5d9-7a7e14e85379" returned: 0 in 0.513s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-beb972e5-11ef-4be5-9154-59928750b4d3 tempest-VolumesListAdminTestJSON-484794847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-263d0acf-cb54-4f7a-b5d9-7a7e14e85379 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:39 devstack sudo[98623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-263d0acf-cb54-4f7a-b5d9-7a7e14e85379 Nov 04 18:57:39 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:39 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-80c3e692-915f-4362-b95a-b69595cbbce3 tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.1b81d19d-e91d-4d19-bd53-c30607e20825" returned: 0 in 0.294s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:39 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-80c3e692-915f-4362-b95a-b69595cbbce3 tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.149s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-beb972e5-11ef-4be5-9154-59928750b4d3 tempest-VolumesListAdminTestJSON-484794847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-263d0acf-cb54-4f7a-b5d9-7a7e14e85379" returned: 0 in 0.318s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:39 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-beb972e5-11ef-4be5-9154-59928750b4d3 tempest-VolumesListAdminTestJSON-484794847 None] Lock "cinder-quobyte-263d0acf-cb54-4f7a-b5d9-7a7e14e85379" released by "delete_volume" :: held 0.921s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:39 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-80c3e692-915f-4362-b95a-b69595cbbce3 tempest-VolumesSnapshotListTestJSON-1407880182 None] Create snapshot completed successfully Nov 04 18:57:39 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-beb972e5-11ef-4be5-9154-59928750b4d3 tempest-VolumesListAdminTestJSON-484794847 None] Created reservations ['c016a8bc-3363-4f72-a08e-458ca0132abd', 'f7d9698e-3b1e-4438-9543-0897e6f16b32', '96b29d81-6dd1-4109-acb2-9f08e69ec17b', '2ad2c47f-b934-4dcd-bd3a-b027fcc1fdff'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:57:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-beb972e5-11ef-4be5-9154-59928750b4d3 tempest-VolumesListAdminTestJSON-484794847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-beb972e5-11ef-4be5-9154-59928750b4d3 tempest-VolumesListAdminTestJSON-484794847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:39 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-beb972e5-11ef-4be5-9154-59928750b4d3 tempest-VolumesListAdminTestJSON-484794847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:39 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-beb972e5-11ef-4be5-9154-59928750b4d3 tempest-VolumesListAdminTestJSON-484794847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-beb972e5-11ef-4be5-9154-59928750b4d3 tempest-VolumesListAdminTestJSON-484794847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-beb972e5-11ef-4be5-9154-59928750b4d3 tempest-VolumesListAdminTestJSON-484794847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:39 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:57:39 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:40 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-beb972e5-11ef-4be5-9154-59928750b4d3 tempest-VolumesListAdminTestJSON-484794847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.262s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:40 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-beb972e5-11ef-4be5-9154-59928750b4d3 tempest-VolumesListAdminTestJSON-484794847 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:57:40 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-beb972e5-11ef-4be5-9154-59928750b4d3 tempest-VolumesListAdminTestJSON-484794847 None] Deleted volume successfully. Nov 04 18:57:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-beb972e5-11ef-4be5-9154-59928750b4d3 tempest-VolumesListAdminTestJSON-484794847 None] Lock "cinder-263d0acf-cb54-4f7a-b5d9-7a7e14e85379-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:41 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ddadd7c2-b7b6-4202-bff3-6723928289c7 tempest-VolumesSnapshotListTestJSON-1407880182 None] Acquiring lock "cinder-1b81d19d-e91d-4d19-bd53-c30607e20825-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:41 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ddadd7c2-b7b6-4202-bff3-6723928289c7 tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "cinder-1b81d19d-e91d-4d19-bd53-c30607e20825-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:41 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ddadd7c2-b7b6-4202-bff3-6723928289c7 tempest-VolumesSnapshotListTestJSON-1407880182 None] Acquiring lock "cinder-quobyte-dcee304e-27e8-4bbc-989f-e61458d58d54" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:41 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ddadd7c2-b7b6-4202-bff3-6723928289c7 tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "cinder-quobyte-dcee304e-27e8-4bbc-989f-e61458d58d54" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:41 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ddadd7c2-b7b6-4202-bff3-6723928289c7 tempest-VolumesSnapshotListTestJSON-1407880182 None] Acquiring lock "cinder-quobyte-1b81d19d-e91d-4d19-bd53-c30607e20825" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:41 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ddadd7c2-b7b6-4202-bff3-6723928289c7 tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "cinder-quobyte-1b81d19d-e91d-4d19-bd53-c30607e20825" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:41 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-ddadd7c2-b7b6-4202-bff3-6723928289c7 tempest-VolumesSnapshotListTestJSON-1407880182 None] Deleting offline snapshot 1b81d19d-e91d-4d19-bd53-c30607e20825 of volume dcee304e-27e8-4bbc-989f-e61458d58d54 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:57:41 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-ddadd7c2-b7b6-4202-bff3-6723928289c7 tempest-VolumesSnapshotListTestJSON-1407880182 None] snapshot_file for this snap is: volume-dcee304e-27e8-4bbc-989f-e61458d58d54.1b81d19d-e91d-4d19-bd53-c30607e20825 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:57:41 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f5a020-0a82-469b-82ce-679b2061e21c]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ddadd7c2-b7b6-4202-bff3-6723928289c7 tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.1b81d19d-e91d-4d19-bd53-c30607e20825 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:42 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.1b81d19d-e91d-4d19-bd53-c30607e20825 Nov 04 18:57:42 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:42 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ddadd7c2-b7b6-4202-bff3-6723928289c7 tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.1b81d19d-e91d-4d19-bd53-c30607e20825" returned: 0 in 0.485s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:42 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-ddadd7c2-b7b6-4202-bff3-6723928289c7 tempest-VolumesSnapshotListTestJSON-1407880182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcee304e-27e8-4bbc-989f-e61458d58d54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:57:42 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a3f4dc-b991-4e83-b47f-e29b8b43e622]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ddadd7c2-b7b6-4202-bff3-6723928289c7 tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:42 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f Nov 04 18:57:42 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:42 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ddadd7c2-b7b6-4202-bff3-6723928289c7 tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f" returned: 0 in 0.431s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:42 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-ddadd7c2-b7b6-4202-bff3-6723928289c7 tempest-VolumesSnapshotListTestJSON-1407880182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcee304e-27e8-4bbc-989f-e61458d58d54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:57:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ddadd7c2-b7b6-4202-bff3-6723928289c7 tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.1b81d19d-e91d-4d19-bd53-c30607e20825 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:42 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.1b81d19d-e91d-4d19-bd53-c30607e20825 Nov 04 18:57:42 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:43 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ddadd7c2-b7b6-4202-bff3-6723928289c7 tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.1b81d19d-e91d-4d19-bd53-c30607e20825" returned: 0 in 0.511s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ddadd7c2-b7b6-4202-bff3-6723928289c7 tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.1b81d19d-e91d-4d19-bd53-c30607e20825 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:43 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.1b81d19d-e91d-4d19-bd53-c30607e20825 Nov 04 18:57:43 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:43 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ddadd7c2-b7b6-4202-bff3-6723928289c7 tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.1b81d19d-e91d-4d19-bd53-c30607e20825" returned: 0 in 0.325s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ddadd7c2-b7b6-4202-bff3-6723928289c7 tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "cinder-quobyte-1b81d19d-e91d-4d19-bd53-c30607e20825" released by "_delete_snapshot" :: held 1.890s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ddadd7c2-b7b6-4202-bff3-6723928289c7 tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "cinder-quobyte-dcee304e-27e8-4bbc-989f-e61458d58d54" released by "delete_snapshot" :: held 1.934s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:43 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-ddadd7c2-b7b6-4202-bff3-6723928289c7 tempest-VolumesSnapshotListTestJSON-1407880182 None] Created reservations ['1c034da4-12a0-46c3-921b-ce61b1152933', '68198e77-381a-4e80-92de-e23ad89bf6f3', '550c1fb4-bb7c-4208-a805-e1e3054867d2', '89518a86-5869-4087-bbfc-ab78f8a089e1'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:57:44 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-ddadd7c2-b7b6-4202-bff3-6723928289c7 tempest-VolumesSnapshotListTestJSON-1407880182 None] Delete snapshot completed successfully. Nov 04 18:57:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ddadd7c2-b7b6-4202-bff3-6723928289c7 tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "cinder-1b81d19d-e91d-4d19-bd53-c30607e20825-delete_snapshot" released by "delete_snapshot" :: held 2.190s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-282b2f03-6c3e-46f6-9b9a-841c2fd00341 tempest-VolumesSnapshotListTestJSON-1407880182 None] Acquiring lock "cinder-c6b143d9-ead9-49b4-b161-207bf627d11f-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-282b2f03-6c3e-46f6-9b9a-841c2fd00341 tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "cinder-c6b143d9-ead9-49b4-b161-207bf627d11f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-282b2f03-6c3e-46f6-9b9a-841c2fd00341 tempest-VolumesSnapshotListTestJSON-1407880182 None] Acquiring lock "cinder-quobyte-dcee304e-27e8-4bbc-989f-e61458d58d54" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-282b2f03-6c3e-46f6-9b9a-841c2fd00341 tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "cinder-quobyte-dcee304e-27e8-4bbc-989f-e61458d58d54" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-282b2f03-6c3e-46f6-9b9a-841c2fd00341 tempest-VolumesSnapshotListTestJSON-1407880182 None] Acquiring lock "cinder-quobyte-c6b143d9-ead9-49b4-b161-207bf627d11f" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-282b2f03-6c3e-46f6-9b9a-841c2fd00341 tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "cinder-quobyte-c6b143d9-ead9-49b4-b161-207bf627d11f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-282b2f03-6c3e-46f6-9b9a-841c2fd00341 tempest-VolumesSnapshotListTestJSON-1407880182 None] Deleting offline snapshot c6b143d9-ead9-49b4-b161-207bf627d11f of volume dcee304e-27e8-4bbc-989f-e61458d58d54 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:57:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-282b2f03-6c3e-46f6-9b9a-841c2fd00341 tempest-VolumesSnapshotListTestJSON-1407880182 None] snapshot_file for this snap is: volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:57:45 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cda355f-f1a4-47c6-8f02-4b30f1b7a0e8]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-282b2f03-6c3e-46f6-9b9a-841c2fd00341 tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:45 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f Nov 04 18:57:45 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:45 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-282b2f03-6c3e-46f6-9b9a-841c2fd00341 tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f" returned: 0 in 0.633s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-282b2f03-6c3e-46f6-9b9a-841c2fd00341 tempest-VolumesSnapshotListTestJSON-1407880182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcee304e-27e8-4bbc-989f-e61458d58d54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:57:45 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b275a79-90d0-4a15-92fd-93bdbeab7c04]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-282b2f03-6c3e-46f6-9b9a-841c2fd00341 tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:46 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486 Nov 04 18:57:46 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:46 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-282b2f03-6c3e-46f6-9b9a-841c2fd00341 tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486" returned: 0 in 0.551s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-282b2f03-6c3e-46f6-9b9a-841c2fd00341 tempest-VolumesSnapshotListTestJSON-1407880182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcee304e-27e8-4bbc-989f-e61458d58d54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:57:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-282b2f03-6c3e-46f6-9b9a-841c2fd00341 tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:46 devstack sudo[98664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f Nov 04 18:57:46 devstack sudo[98664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:47 devstack sudo[98664]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-282b2f03-6c3e-46f6-9b9a-841c2fd00341 tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f" returned: 0 in 0.734s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-282b2f03-6c3e-46f6-9b9a-841c2fd00341 tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:47 devstack sudo[98707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f Nov 04 18:57:47 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:47 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-282b2f03-6c3e-46f6-9b9a-841c2fd00341 tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.c6b143d9-ead9-49b4-b161-207bf627d11f" returned: 0 in 0.512s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:47 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-282b2f03-6c3e-46f6-9b9a-841c2fd00341 tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "cinder-quobyte-c6b143d9-ead9-49b4-b161-207bf627d11f" released by "_delete_snapshot" :: held 2.632s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:47 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-282b2f03-6c3e-46f6-9b9a-841c2fd00341 tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "cinder-quobyte-dcee304e-27e8-4bbc-989f-e61458d58d54" released by "delete_snapshot" :: held 2.671s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:48 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-282b2f03-6c3e-46f6-9b9a-841c2fd00341 tempest-VolumesSnapshotListTestJSON-1407880182 None] Created reservations ['d7b0bf55-2412-46ea-8776-21edaa71eea3', 'b4295cbc-7c1f-4e4d-abbf-2fa26993b98a', 'b0a839ff-09d6-42fc-83ff-f64bc5c68d8a', '75b7d381-b994-4ee0-9c9e-de929d5d126a'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:57:48 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-282b2f03-6c3e-46f6-9b9a-841c2fd00341 tempest-VolumesSnapshotListTestJSON-1407880182 None] Delete snapshot completed successfully. Nov 04 18:57:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-282b2f03-6c3e-46f6-9b9a-841c2fd00341 tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "cinder-c6b143d9-ead9-49b4-b161-207bf627d11f-delete_snapshot" released by "delete_snapshot" :: held 2.989s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9a6f2e78-e8aa-4ae5-9391-fe101cc5edc8 tempest-VolumesSnapshotListTestJSON-1407880182 None] Acquiring lock "cinder-b5031cf4-c1ce-4e72-93c0-82b41c8ff486-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9a6f2e78-e8aa-4ae5-9391-fe101cc5edc8 tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "cinder-b5031cf4-c1ce-4e72-93c0-82b41c8ff486-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9a6f2e78-e8aa-4ae5-9391-fe101cc5edc8 tempest-VolumesSnapshotListTestJSON-1407880182 None] Acquiring lock "cinder-quobyte-dcee304e-27e8-4bbc-989f-e61458d58d54" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9a6f2e78-e8aa-4ae5-9391-fe101cc5edc8 tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "cinder-quobyte-dcee304e-27e8-4bbc-989f-e61458d58d54" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9a6f2e78-e8aa-4ae5-9391-fe101cc5edc8 tempest-VolumesSnapshotListTestJSON-1407880182 None] Acquiring lock "cinder-quobyte-b5031cf4-c1ce-4e72-93c0-82b41c8ff486" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9a6f2e78-e8aa-4ae5-9391-fe101cc5edc8 tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "cinder-quobyte-b5031cf4-c1ce-4e72-93c0-82b41c8ff486" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-9a6f2e78-e8aa-4ae5-9391-fe101cc5edc8 tempest-VolumesSnapshotListTestJSON-1407880182 None] Deleting offline snapshot b5031cf4-c1ce-4e72-93c0-82b41c8ff486 of volume dcee304e-27e8-4bbc-989f-e61458d58d54 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:57:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-9a6f2e78-e8aa-4ae5-9391-fe101cc5edc8 tempest-VolumesSnapshotListTestJSON-1407880182 None] snapshot_file for this snap is: volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:57:48 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[692f2cbf-ffa3-4f61-b042-e9e40b771882]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9a6f2e78-e8aa-4ae5-9391-fe101cc5edc8 tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:48 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486 Nov 04 18:57:48 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:49 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9a6f2e78-e8aa-4ae5-9391-fe101cc5edc8 tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486" returned: 0 in 0.494s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:49 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-9a6f2e78-e8aa-4ae5-9391-fe101cc5edc8 tempest-VolumesSnapshotListTestJSON-1407880182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcee304e-27e8-4bbc-989f-e61458d58d54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:57:49 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8ea961-4a1d-49f5-9692-aff529c00750]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9a6f2e78-e8aa-4ae5-9391-fe101cc5edc8 tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:49 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54 Nov 04 18:57:49 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:49 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9a6f2e78-e8aa-4ae5-9391-fe101cc5edc8 tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54" returned: 0 in 0.413s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9a6f2e78-e8aa-4ae5-9391-fe101cc5edc8 tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:49 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486 Nov 04 18:57:49 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:49 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9a6f2e78-e8aa-4ae5-9391-fe101cc5edc8 tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486" returned: 0 in 0.441s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9a6f2e78-e8aa-4ae5-9391-fe101cc5edc8 tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:49 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486 Nov 04 18:57:49 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:50 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9a6f2e78-e8aa-4ae5-9391-fe101cc5edc8 tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54.b5031cf4-c1ce-4e72-93c0-82b41c8ff486" returned: 0 in 0.273s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:50 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9a6f2e78-e8aa-4ae5-9391-fe101cc5edc8 tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "cinder-quobyte-b5031cf4-c1ce-4e72-93c0-82b41c8ff486" released by "_delete_snapshot" :: held 1.759s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:50 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9a6f2e78-e8aa-4ae5-9391-fe101cc5edc8 tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "cinder-quobyte-dcee304e-27e8-4bbc-989f-e61458d58d54" released by "delete_snapshot" :: held 1.787s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:50 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-9a6f2e78-e8aa-4ae5-9391-fe101cc5edc8 tempest-VolumesSnapshotListTestJSON-1407880182 None] Created reservations ['d1c136c8-5188-4a6f-9817-2679dad070c4', '302f53f4-84c4-4070-b5c0-34ba778f53a7', '39218e00-9054-4cd4-9738-5b8025a51bd4', 'ba67bb44-f454-4a15-a6d0-4d2d27752bb4'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:57:50 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-9a6f2e78-e8aa-4ae5-9391-fe101cc5edc8 tempest-VolumesSnapshotListTestJSON-1407880182 None] Delete snapshot completed successfully. Nov 04 18:57:50 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9a6f2e78-e8aa-4ae5-9391-fe101cc5edc8 tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "cinder-b5031cf4-c1ce-4e72-93c0-82b41c8ff486-delete_snapshot" released by "delete_snapshot" :: held 1.974s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:50 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-04f7c929-e44b-4748-9101-18c7e0dd379b tempest-VolumesSnapshotListTestJSON-1407880182 None] Acquiring lock "cinder-dcee304e-27e8-4bbc-989f-e61458d58d54-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:50 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-04f7c929-e44b-4748-9101-18c7e0dd379b tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "cinder-dcee304e-27e8-4bbc-989f-e61458d58d54-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:50 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-04f7c929-e44b-4748-9101-18c7e0dd379b tempest-VolumesSnapshotListTestJSON-1407880182 None] Acquiring lock "cinder-quobyte-dcee304e-27e8-4bbc-989f-e61458d58d54" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:50 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-04f7c929-e44b-4748-9101-18c7e0dd379b tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "cinder-quobyte-dcee304e-27e8-4bbc-989f-e61458d58d54" acquired by "delete_volume" :: waited 0.027s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:51 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b32195-6bc9-4e1f-8615-ece02f578436]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-04f7c929-e44b-4748-9101-18c7e0dd379b tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:51 devstack sudo[98746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54 Nov 04 18:57:51 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:51 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-04f7c929-e44b-4748-9101-18c7e0dd379b tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54" returned: 0 in 0.793s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-04f7c929-e44b-4748-9101-18c7e0dd379b tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:51 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54 Nov 04 18:57:51 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:52 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-04f7c929-e44b-4748-9101-18c7e0dd379b tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-dcee304e-27e8-4bbc-989f-e61458d58d54" returned: 0 in 0.521s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:52 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-04f7c929-e44b-4748-9101-18c7e0dd379b tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "cinder-quobyte-dcee304e-27e8-4bbc-989f-e61458d58d54" released by "delete_volume" :: held 1.415s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:52 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-04f7c929-e44b-4748-9101-18c7e0dd379b tempest-VolumesSnapshotListTestJSON-1407880182 None] Created reservations ['d597eb63-0214-4bbc-a6f2-97bb8e4bb2b4', '8a0ba91d-6778-4f2c-ad16-6b714732335c', 'fe17701e-dc8c-4557-872f-fedbe2893b88', '6911117e-f8fe-44f5-86cd-9dedae7734d9'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:57:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-04f7c929-e44b-4748-9101-18c7e0dd379b tempest-VolumesSnapshotListTestJSON-1407880182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-04f7c929-e44b-4748-9101-18c7e0dd379b tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:52 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-04f7c929-e44b-4748-9101-18c7e0dd379b tempest-VolumesSnapshotListTestJSON-1407880182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:52 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-04f7c929-e44b-4748-9101-18c7e0dd379b tempest-VolumesSnapshotListTestJSON-1407880182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-04f7c929-e44b-4748-9101-18c7e0dd379b tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-04f7c929-e44b-4748-9101-18c7e0dd379b tempest-VolumesSnapshotListTestJSON-1407880182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:52 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:57:52 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:53 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-04f7c929-e44b-4748-9101-18c7e0dd379b tempest-VolumesSnapshotListTestJSON-1407880182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.440s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:53 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-04f7c929-e44b-4748-9101-18c7e0dd379b tempest-VolumesSnapshotListTestJSON-1407880182 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:57:53 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-04f7c929-e44b-4748-9101-18c7e0dd379b tempest-VolumesSnapshotListTestJSON-1407880182 None] Deleted volume successfully. Nov 04 18:57:53 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-04f7c929-e44b-4748-9101-18c7e0dd379b tempest-VolumesSnapshotListTestJSON-1407880182 None] Lock "cinder-dcee304e-27e8-4bbc-989f-e61458d58d54-delete_volume" released by "delete_volume" :: held 2.204s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:56 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:57:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Flow 'volume_create_manager' (3912b9d7-de95-4e38-8baf-c63b224a666d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7356fa42-23ec-4af9-a6b0-de5479da1e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7356fa42-23ec-4af9-a6b0-de5479da1e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2695392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf35ab5a-9a96-4a36-9d40-e610303fec3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3498934595f7486890edc9d444f6675b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:56Z,use_quota=True,user_id='6bafeb61ed23476aad09e40720ba47ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7b2742-ac9a-47d4-a41f-bcdc874290f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7b2742-ac9a-47d4-a41f-bcdc874290f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (641365e7-55e3-4085-b64c-97d40a4360da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (641365e7-55e3-4085-b64c-97d40a4360da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf35ab5a-9a96-4a36-9d40-e610303fec3b', 'volume_name': 'volume-cf35ab5a-9a96-4a36-9d40-e610303fec3b', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9820cf1-1f66-429c-8d27-0cc91ac4c488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9820cf1-1f66-429c-8d27-0cc91ac4c488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (310a3b68-799d-4955-a08f-0938cfe1a75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:56 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Volume cf35ab5a-9a96-4a36-9d40-e610303fec3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf35ab5a-9a96-4a36-9d40-e610303fec3b', 'volume_size': 1} Nov 04 18:57:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:56 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2695392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf35ab5a-9a96-4a36-9d40-e610303fec3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3498934595f7486890edc9d444f6675b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:56Z,use_quota=True,user_id='6bafeb61ed23476aad09e40720ba47ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:57:56 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Creating volume cf35ab5a-9a96-4a36-9d40-e610303fec3b {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:57:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:56 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:56 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:56 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:57:56 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:57:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cf35ab5a-9a96-4a36-9d40-e610303fec3b 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:56 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cf35ab5a-9a96-4a36-9d40-e610303fec3b 1073741824 Nov 04 18:57:56 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:56 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cf35ab5a-9a96-4a36-9d40-e610303fec3b 1073741824" returned: 0 in 0.668s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cf35ab5a-9a96-4a36-9d40-e610303fec3b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:56 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cf35ab5a-9a96-4a36-9d40-e610303fec3b Nov 04 18:57:56 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:57 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cf35ab5a-9a96-4a36-9d40-e610303fec3b" returned: 0 in 0.351s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:57:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (310a3b68-799d-4955-a08f-0938cfe1a75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf35ab5a-9a96-4a36-9d40-e610303fec3b', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751f2c75-8f1b-4918-8e94-61857efc4c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:57 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Volume volume-cf35ab5a-9a96-4a36-9d40-e610303fec3b (cf35ab5a-9a96-4a36-9d40-e610303fec3b): created successfully Nov 04 18:57:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751f2c75-8f1b-4918-8e94-61857efc4c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Flow 'volume_create_manager' (3912b9d7-de95-4e38-8baf-c63b224a666d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:57 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-222cf89c-e981-4cf4-87d3-fa7af7bb3184 tempest-AbsoluteLimitsTests-1993185426 None] Created volume successfully. Nov 04 18:57:59 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e3b29033-1813-4e4e-a3a3-a991e84eb46f tempest-AbsoluteLimitsTests-1993185426 None] Acquiring lock "cinder-cf35ab5a-9a96-4a36-9d40-e610303fec3b-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:59 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e3b29033-1813-4e4e-a3a3-a991e84eb46f tempest-AbsoluteLimitsTests-1993185426 None] Lock "cinder-cf35ab5a-9a96-4a36-9d40-e610303fec3b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:59 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e3b29033-1813-4e4e-a3a3-a991e84eb46f tempest-AbsoluteLimitsTests-1993185426 None] Acquiring lock "cinder-quobyte-cf35ab5a-9a96-4a36-9d40-e610303fec3b" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:59 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e3b29033-1813-4e4e-a3a3-a991e84eb46f tempest-AbsoluteLimitsTests-1993185426 None] Lock "cinder-quobyte-cf35ab5a-9a96-4a36-9d40-e610303fec3b" acquired by "delete_volume" :: waited 0.030s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:59 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8490e4-36fd-46ed-a1da-a231ed8b97b7]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e3b29033-1813-4e4e-a3a3-a991e84eb46f tempest-AbsoluteLimitsTests-1993185426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cf35ab5a-9a96-4a36-9d40-e610303fec3b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:59 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cf35ab5a-9a96-4a36-9d40-e610303fec3b Nov 04 18:57:59 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:59 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e3b29033-1813-4e4e-a3a3-a991e84eb46f tempest-AbsoluteLimitsTests-1993185426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cf35ab5a-9a96-4a36-9d40-e610303fec3b" returned: 0 in 0.544s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e3b29033-1813-4e4e-a3a3-a991e84eb46f tempest-AbsoluteLimitsTests-1993185426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cf35ab5a-9a96-4a36-9d40-e610303fec3b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:59 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cf35ab5a-9a96-4a36-9d40-e610303fec3b Nov 04 18:57:59 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:00 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e3b29033-1813-4e4e-a3a3-a991e84eb46f tempest-AbsoluteLimitsTests-1993185426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cf35ab5a-9a96-4a36-9d40-e610303fec3b" returned: 0 in 0.295s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:00 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e3b29033-1813-4e4e-a3a3-a991e84eb46f tempest-AbsoluteLimitsTests-1993185426 None] Lock "cinder-quobyte-cf35ab5a-9a96-4a36-9d40-e610303fec3b" released by "delete_volume" :: held 0.911s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:58:00 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-e3b29033-1813-4e4e-a3a3-a991e84eb46f tempest-AbsoluteLimitsTests-1993185426 None] Created reservations ['cd490fa0-ab8d-4c83-807e-01e2fe2ccff3', '1701679a-f697-4d10-a141-b622ae4de914', 'b9f72232-7358-46a0-9a4c-b0c6bd131431', '4cd060c5-3f36-4a12-bb76-74d2a14ea0c7'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:58:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e3b29033-1813-4e4e-a3a3-a991e84eb46f tempest-AbsoluteLimitsTests-1993185426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e3b29033-1813-4e4e-a3a3-a991e84eb46f tempest-AbsoluteLimitsTests-1993185426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:00 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e3b29033-1813-4e4e-a3a3-a991e84eb46f tempest-AbsoluteLimitsTests-1993185426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:58:00 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e3b29033-1813-4e4e-a3a3-a991e84eb46f tempest-AbsoluteLimitsTests-1993185426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:58:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e3b29033-1813-4e4e-a3a3-a991e84eb46f tempest-AbsoluteLimitsTests-1993185426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e3b29033-1813-4e4e-a3a3-a991e84eb46f tempest-AbsoluteLimitsTests-1993185426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:00 devstack sudo[98848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:58:00 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:00 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:58:00 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Flow 'volume_create_manager' (6c20727e-e090-4d13-bc99-7f554de8c754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:58:00 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdb9e758-a3a0-4aff-a427-7929166b7d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:00 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:00 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdb9e758-a3a0-4aff-a427-7929166b7d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-833306470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade59657-904d-4909-a3f3-170215907f9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9c14c6f06a40708f90a46a9a88774c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:58:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:58:01Z,use_quota=True,user_id='1dd8804f925a4dcdbf8052e8f5dd53aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:00 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1105f7-8c45-400c-b290-a104d53e0737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:00 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1105f7-8c45-400c-b290-a104d53e0737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:00 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7f9ab7-7a41-4e62-97a1-1a2650617e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:00 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7f9ab7-7a41-4e62-97a1-1a2650617e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ade59657-904d-4909-a3f3-170215907f9c', 'volume_name': 'volume-ade59657-904d-4909-a3f3-170215907f9c', 'volume_size': 2}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:00 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4af009-bece-4a05-8e11-4cd55ff671ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:00 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4af009-bece-4a05-8e11-4cd55ff671ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:00 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1987b1e3-2dc2-4847-ab65-5c607a74ab12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:00 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Volume ade59657-904d-4909-a3f3-170215907f9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ade59657-904d-4909-a3f3-170215907f9c', 'volume_size': 2} Nov 04 18:58:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:00 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-833306470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade59657-904d-4909-a3f3-170215907f9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9c14c6f06a40708f90a46a9a88774c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:58:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:58:01Z,use_quota=True,user_id='1dd8804f925a4dcdbf8052e8f5dd53aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:58:00 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Creating volume ade59657-904d-4909-a3f3-170215907f9c {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:58:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:00 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:58:01 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:58:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:01 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:58:01 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:58:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c 2147483648 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e3b29033-1813-4e4e-a3a3-a991e84eb46f tempest-AbsoluteLimitsTests-1993185426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.706s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:01 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-e3b29033-1813-4e4e-a3a3-a991e84eb46f tempest-AbsoluteLimitsTests-1993185426 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:58:01 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e3b29033-1813-4e4e-a3a3-a991e84eb46f tempest-AbsoluteLimitsTests-1993185426 None] Deleted volume successfully. Nov 04 18:58:01 devstack sudo[98851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c 2147483648 Nov 04 18:58:01 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:01 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e3b29033-1813-4e4e-a3a3-a991e84eb46f tempest-AbsoluteLimitsTests-1993185426 None] Lock "cinder-cf35ab5a-9a96-4a36-9d40-e610303fec3b-delete_volume" released by "delete_volume" :: held 1.993s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:58:01 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c 2147483648" returned: 0 in 0.746s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:01 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c Nov 04 18:58:01 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:02 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c" returned: 0 in 0.380s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:58:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1987b1e3-2dc2-4847-ab65-5c607a74ab12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ade59657-904d-4909-a3f3-170215907f9c', 'volume_size': 2}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4beadac-d446-449c-abf7-072f1157f6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:02 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Volume volume-ade59657-904d-4909-a3f3-170215907f9c (ade59657-904d-4909-a3f3-170215907f9c): created successfully Nov 04 18:58:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4beadac-d446-449c-abf7-072f1157f6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Flow 'volume_create_manager' (6c20727e-e090-4d13-bc99-7f554de8c754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:58:02 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-72a663ac-9729-4159-a68b-95405d33f6c0 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Created volume successfully. Nov 04 18:58:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0024bb02-8143-42a3-a23b-d708e262cb53 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0024bb02-8143-42a3-a23b-d708e262cb53 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-0024bb02-8143-42a3-a23b-d708e262cb53 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Creating offline snapshot 9158372d-809d-44f7-a931-7ced2ee66f74 of volume ade59657-904d-4909-a3f3-170215907f9c {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:58:03 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f7a3eb-61e8-4870-9350-ad7039611b49]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:58:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0024bb02-8143-42a3-a23b-d708e262cb53 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:03 devstack sudo[98863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c Nov 04 18:58:03 devstack sudo[98863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:03 devstack sudo[98863]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0024bb02-8143-42a3-a23b-d708e262cb53 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c" returned: 0 in 0.505s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0024bb02-8143-42a3-a23b-d708e262cb53 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c.9158372d-809d-44f7-a931-7ced2ee66f74 2G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:03 devstack sudo[98868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c.9158372d-809d-44f7-a931-7ced2ee66f74 2G Nov 04 18:58:03 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:04 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0024bb02-8143-42a3-a23b-d708e262cb53 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c.9158372d-809d-44f7-a931-7ced2ee66f74 2G" returned: 0 in 0.578s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0024bb02-8143-42a3-a23b-d708e262cb53 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ade59657-904d-4909-a3f3-170215907f9c -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c.9158372d-809d-44f7-a931-7ced2ee66f74 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:04 devstack sudo[98874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ade59657-904d-4909-a3f3-170215907f9c -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c.9158372d-809d-44f7-a931-7ced2ee66f74 Nov 04 18:58:04 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:04 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0024bb02-8143-42a3-a23b-d708e262cb53 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ade59657-904d-4909-a3f3-170215907f9c -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c.9158372d-809d-44f7-a931-7ced2ee66f74" returned: 0 in 0.427s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:04 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-0024bb02-8143-42a3-a23b-d708e262cb53 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c.9158372d-809d-44f7-a931-7ced2ee66f74 is being set with open permissions: ugo+rw Nov 04 18:58:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0024bb02-8143-42a3-a23b-d708e262cb53 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c.9158372d-809d-44f7-a931-7ced2ee66f74 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:04 devstack sudo[98879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c.9158372d-809d-44f7-a931-7ced2ee66f74 Nov 04 18:58:04 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:05 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0024bb02-8143-42a3-a23b-d708e262cb53 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c.9158372d-809d-44f7-a931-7ced2ee66f74" returned: 0 in 0.349s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0024bb02-8143-42a3-a23b-d708e262cb53 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:05 devstack sudo[98882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c.info Nov 04 18:58:05 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:05 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0024bb02-8143-42a3-a23b-d708e262cb53 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c.info" returned: 0 in 0.320s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:05 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-0024bb02-8143-42a3-a23b-d708e262cb53 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c.info is being set with open permissions: ugo+rw Nov 04 18:58:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0024bb02-8143-42a3-a23b-d708e262cb53 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:05 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c.info Nov 04 18:58:05 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:05 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0024bb02-8143-42a3-a23b-d708e262cb53 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c.info" returned: 0 in 0.336s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0024bb02-8143-42a3-a23b-d708e262cb53 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.716s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:05 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-0024bb02-8143-42a3-a23b-d708e262cb53 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Create snapshot completed successfully Nov 04 18:58:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-84e82c4e-4db1-419c-934b-6f51cc22a4b6 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Acquiring lock "cinder-9158372d-809d-44f7-a931-7ced2ee66f74-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:58:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-84e82c4e-4db1-419c-934b-6f51cc22a4b6 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Lock "cinder-9158372d-809d-44f7-a931-7ced2ee66f74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:58:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-84e82c4e-4db1-419c-934b-6f51cc22a4b6 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Acquiring lock "cinder-quobyte-ade59657-904d-4909-a3f3-170215907f9c" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:58:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-84e82c4e-4db1-419c-934b-6f51cc22a4b6 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Lock "cinder-quobyte-ade59657-904d-4909-a3f3-170215907f9c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:58:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-84e82c4e-4db1-419c-934b-6f51cc22a4b6 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Acquiring lock "cinder-quobyte-9158372d-809d-44f7-a931-7ced2ee66f74" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:58:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-84e82c4e-4db1-419c-934b-6f51cc22a4b6 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Lock "cinder-quobyte-9158372d-809d-44f7-a931-7ced2ee66f74" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:58:06 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-84e82c4e-4db1-419c-934b-6f51cc22a4b6 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Deleting offline snapshot 9158372d-809d-44f7-a931-7ced2ee66f74 of volume ade59657-904d-4909-a3f3-170215907f9c {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:58:06 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-84e82c4e-4db1-419c-934b-6f51cc22a4b6 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] snapshot_file for this snap is: volume-ade59657-904d-4909-a3f3-170215907f9c.9158372d-809d-44f7-a931-7ced2ee66f74 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:58:06 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c30de78-8ae2-45cc-b1f1-367dae63025b]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:58:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-84e82c4e-4db1-419c-934b-6f51cc22a4b6 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c.9158372d-809d-44f7-a931-7ced2ee66f74 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:06 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c.9158372d-809d-44f7-a931-7ced2ee66f74 Nov 04 18:58:06 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:07 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-84e82c4e-4db1-419c-934b-6f51cc22a4b6 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c.9158372d-809d-44f7-a931-7ced2ee66f74" returned: 0 in 0.498s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-84e82c4e-4db1-419c-934b-6f51cc22a4b6 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ade59657-904d-4909-a3f3-170215907f9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:58:07 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97cbb87-d959-49d4-9925-78be1b15e39f]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:58:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-84e82c4e-4db1-419c-934b-6f51cc22a4b6 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:07 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c Nov 04 18:58:07 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:07 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-84e82c4e-4db1-419c-934b-6f51cc22a4b6 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c" returned: 0 in 0.456s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-84e82c4e-4db1-419c-934b-6f51cc22a4b6 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c.9158372d-809d-44f7-a931-7ced2ee66f74 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:07 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c.9158372d-809d-44f7-a931-7ced2ee66f74 Nov 04 18:58:07 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:08 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Flow 'volume_create_manager' (09f8664c-7aa0-4587-b074-aca33e3a0287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e343f785-56ae-4d49-930d-39c725200381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-84e82c4e-4db1-419c-934b-6f51cc22a4b6 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c.9158372d-809d-44f7-a931-7ced2ee66f74" returned: 0 in 0.467s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-84e82c4e-4db1-419c-934b-6f51cc22a4b6 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c.9158372d-809d-44f7-a931-7ced2ee66f74 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e343f785-56ae-4d49-930d-39c725200381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1367898938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce0e01b-0506-41c1-bc50-56a3c2f18265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52099ece48b64eefbd3e180b25f64663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:58:08Z,use_quota=True,user_id='37a98bd2e58e4b4d842fb4c9dcf51a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:08 devstack sudo[98920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c.9158372d-809d-44f7-a931-7ced2ee66f74 Nov 04 18:58:08 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46acecd-345a-47df-8d7f-4e409f65fbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46acecd-345a-47df-8d7f-4e409f65fbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d2ab0ca-1c81-4970-9bf4-4b7b435f0a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d2ab0ca-1c81-4970-9bf4-4b7b435f0a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ce0e01b-0506-41c1-bc50-56a3c2f18265', 'volume_name': 'volume-3ce0e01b-0506-41c1-bc50-56a3c2f18265', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c8641d0-0240-4dcd-aa8d-e07e7383b6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c8641d0-0240-4dcd-aa8d-e07e7383b6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f378a7-ab0b-4877-8c4b-b7f5773c39af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:08 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Volume 3ce0e01b-0506-41c1-bc50-56a3c2f18265: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ce0e01b-0506-41c1-bc50-56a3c2f18265', 'volume_size': 1} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1367898938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce0e01b-0506-41c1-bc50-56a3c2f18265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52099ece48b64eefbd3e180b25f64663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:58:08Z,use_quota=True,user_id='37a98bd2e58e4b4d842fb4c9dcf51a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Creating volume 3ce0e01b-0506-41c1-bc50-56a3c2f18265 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:58:08 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3ce0e01b-0506-41c1-bc50-56a3c2f18265 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:08 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3ce0e01b-0506-41c1-bc50-56a3c2f18265 1073741824 Nov 04 18:58:08 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:08 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-84e82c4e-4db1-419c-934b-6f51cc22a4b6 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c.9158372d-809d-44f7-a931-7ced2ee66f74" returned: 0 in 0.282s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-84e82c4e-4db1-419c-934b-6f51cc22a4b6 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Lock "cinder-quobyte-9158372d-809d-44f7-a931-7ced2ee66f74" released by "_delete_snapshot" :: held 1.854s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-84e82c4e-4db1-419c-934b-6f51cc22a4b6 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Lock "cinder-quobyte-ade59657-904d-4909-a3f3-170215907f9c" released by "delete_snapshot" :: held 1.886s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-84e82c4e-4db1-419c-934b-6f51cc22a4b6 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Created reservations ['6d5b1adb-359b-49dc-971b-2c16beeb1e5d', '285ec04c-b5c7-4ccd-bdc9-a20f3520d291', '9a722c5e-de5b-4b7b-9b60-270b0b11671e', '310eb66d-a0a9-4a47-aa22-d39dd2d4b39b'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:58:08 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-84e82c4e-4db1-419c-934b-6f51cc22a4b6 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Delete snapshot completed successfully. Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-84e82c4e-4db1-419c-934b-6f51cc22a4b6 tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Lock "cinder-9158372d-809d-44f7-a931-7ced2ee66f74-delete_snapshot" released by "delete_snapshot" :: held 2.067s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:58:08 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3ce0e01b-0506-41c1-bc50-56a3c2f18265 1073741824" returned: 0 in 0.552s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3ce0e01b-0506-41c1-bc50-56a3c2f18265 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-42ffc9c1-a8a9-4937-b8f5-7154309612ff tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Acquiring lock "cinder-ade59657-904d-4909-a3f3-170215907f9c-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:58:08 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3ce0e01b-0506-41c1-bc50-56a3c2f18265 Nov 04 18:58:08 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-42ffc9c1-a8a9-4937-b8f5-7154309612ff tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Lock "cinder-ade59657-904d-4909-a3f3-170215907f9c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-42ffc9c1-a8a9-4937-b8f5-7154309612ff tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Acquiring lock "cinder-quobyte-ade59657-904d-4909-a3f3-170215907f9c" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-42ffc9c1-a8a9-4937-b8f5-7154309612ff tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Lock "cinder-quobyte-ade59657-904d-4909-a3f3-170215907f9c" acquired by "delete_volume" :: waited 0.018s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cdef12-2350-4e39-8f9c-959a9036334e]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:58:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-42ffc9c1-a8a9-4937-b8f5-7154309612ff tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:09 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3ce0e01b-0506-41c1-bc50-56a3c2f18265" returned: 0 in 0.292s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:58:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f378a7-ab0b-4877-8c4b-b7f5773c39af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ce0e01b-0506-41c1-bc50-56a3c2f18265', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:09 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c Nov 04 18:58:09 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (050835de-b437-43a8-9681-0ceec3127b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:09 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Volume volume-3ce0e01b-0506-41c1-bc50-56a3c2f18265 (3ce0e01b-0506-41c1-bc50-56a3c2f18265): created successfully Nov 04 18:58:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (050835de-b437-43a8-9681-0ceec3127b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Flow 'volume_create_manager' (09f8664c-7aa0-4587-b074-aca33e3a0287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:58:09 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-3857df69-29ce-409c-b26c-b322930399cb tempest-VolumesNegativeTest-403211708 None] Created volume successfully. Nov 04 18:58:09 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-42ffc9c1-a8a9-4937-b8f5-7154309612ff tempest-VolumesSnapshotNegativeTestJSON-225591098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c" returned: 0 in 0.403s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-42ffc9c1-a8a9-4937-b8f5-7154309612ff tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:09 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c Nov 04 18:58:09 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:09 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-42ffc9c1-a8a9-4937-b8f5-7154309612ff tempest-VolumesSnapshotNegativeTestJSON-225591098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ade59657-904d-4909-a3f3-170215907f9c" returned: 0 in 0.260s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-42ffc9c1-a8a9-4937-b8f5-7154309612ff tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Lock "cinder-quobyte-ade59657-904d-4909-a3f3-170215907f9c" released by "delete_volume" :: held 0.736s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:58:09 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-42ffc9c1-a8a9-4937-b8f5-7154309612ff tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Created reservations ['fbbd8963-87c9-47c8-9835-4c84213f91c2', '98d2793c-ac83-4b22-b60b-18f516d5f52d', 'ca2923d9-e1d8-46cb-8fd7-ccdb8ce6a817', '0deef7df-f2d7-4c48-bc1a-7dac71c27b98'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:58:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-42ffc9c1-a8a9-4937-b8f5-7154309612ff tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-42ffc9c1-a8a9-4937-b8f5-7154309612ff tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-42ffc9c1-a8a9-4937-b8f5-7154309612ff tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:58:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-42ffc9c1-a8a9-4937-b8f5-7154309612ff tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:58:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-42ffc9c1-a8a9-4937-b8f5-7154309612ff tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-42ffc9c1-a8a9-4937-b8f5-7154309612ff tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:09 devstack sudo[98941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:58:09 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:10 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-42ffc9c1-a8a9-4937-b8f5-7154309612ff tempest-VolumesSnapshotNegativeTestJSON-225591098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.291s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:10 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-42ffc9c1-a8a9-4937-b8f5-7154309612ff tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:58:10 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-42ffc9c1-a8a9-4937-b8f5-7154309612ff tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Deleted volume successfully. Nov 04 18:58:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-42ffc9c1-a8a9-4937-b8f5-7154309612ff tempest-VolumesSnapshotNegativeTestJSON-225591098 None] Lock "cinder-ade59657-904d-4909-a3f3-170215907f9c-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:58:18 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:58:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Flow 'volume_create_manager' (439a1fbc-b083-4dd3-b36f-43bcc6ed4b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:58:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e41a5f7-322f-41e8-bd71-4f9fc14d18c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e41a5f7-322f-41e8-bd71-4f9fc14d18c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1902835680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b06aa4-a718-4d0e-a27e-dce5e0d673ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a89143e489b846c68d02b2c99b97d011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:58:19Z,use_quota=True,user_id='2df3cb21008e46d48baecb25ef9390f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c6c171-4047-454c-a4a4-d323b48ea638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c6c171-4047-454c-a4a4-d323b48ea638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ac212e-de5c-4f82-9cf3-a30d0113a241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ac212e-de5c-4f82-9cf3-a30d0113a241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50b06aa4-a718-4d0e-a27e-dce5e0d673ed', 'volume_name': 'volume-50b06aa4-a718-4d0e-a27e-dce5e0d673ed', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfa2503-1e09-4e5f-82f8-503abaf0a3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfa2503-1e09-4e5f-82f8-503abaf0a3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6582fe86-a1fb-4452-8b1d-6bef8adc6a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:18 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Volume 50b06aa4-a718-4d0e-a27e-dce5e0d673ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50b06aa4-a718-4d0e-a27e-dce5e0d673ed', 'volume_size': 1} Nov 04 18:58:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:18 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1902835680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b06aa4-a718-4d0e-a27e-dce5e0d673ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a89143e489b846c68d02b2c99b97d011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:58:19Z,use_quota=True,user_id='2df3cb21008e46d48baecb25ef9390f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:58:18 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Creating volume 50b06aa4-a718-4d0e-a27e-dce5e0d673ed {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:58:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:18 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:58:18 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:58:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:18 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:58:18 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:58:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-50b06aa4-a718-4d0e-a27e-dce5e0d673ed 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:19 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-50b06aa4-a718-4d0e-a27e-dce5e0d673ed 1073741824 Nov 04 18:58:19 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:19 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-50b06aa4-a718-4d0e-a27e-dce5e0d673ed 1073741824" returned: 0 in 0.617s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:19 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=102,cinder:INSERT=34,cinder:UPDATE=145,cinder:DELETE=11 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:58:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-50b06aa4-a718-4d0e-a27e-dce5e0d673ed {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:19 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-50b06aa4-a718-4d0e-a27e-dce5e0d673ed Nov 04 18:58:19 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:20 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-50b06aa4-a718-4d0e-a27e-dce5e0d673ed" returned: 0 in 0.369s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6582fe86-a1fb-4452-8b1d-6bef8adc6a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50b06aa4-a718-4d0e-a27e-dce5e0d673ed', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b34f41ab-6b0f-4865-af96-fe323cab9284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:20 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Volume volume-50b06aa4-a718-4d0e-a27e-dce5e0d673ed (50b06aa4-a718-4d0e-a27e-dce5e0d673ed): created successfully Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b34f41ab-6b0f-4865-af96-fe323cab9284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Flow 'volume_create_manager' (439a1fbc-b083-4dd3-b36f-43bcc6ed4b0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:58:20 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-c9dae706-bd0a-45b1-a7a5-9fb9be629004 tempest-AttachVolumeNegativeTest-722614164 None] Created volume successfully. Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Flow 'volume_create_manager' (b984e134-9bf5-4a35-a351-fb884015c39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64976b73-5d2d-49a8-b032-dd695afdc351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64976b73-5d2d-49a8-b032-dd695afdc351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-572416034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce5146a0-e707-4c97-ac65-426c04d72f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48dcd290f117430a864591ed66710a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:58:20Z,use_quota=True,user_id='e39e9f396f0645fba947d06e60f82b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55f4aeb2-461f-4ddc-826c-f30be04ddf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55f4aeb2-461f-4ddc-826c-f30be04ddf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c328b76-cf82-4137-ab20-4953d791229e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c328b76-cf82-4137-ab20-4953d791229e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce5146a0-e707-4c97-ac65-426c04d72f51', 'volume_name': 'volume-ce5146a0-e707-4c97-ac65-426c04d72f51', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b0d527e-874e-46c7-a8f5-e2331b68c38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b0d527e-874e-46c7-a8f5-e2331b68c38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e051b34-71ed-4eb1-885c-99e50aec9ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:20 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Volume ce5146a0-e707-4c97-ac65-426c04d72f51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce5146a0-e707-4c97-ac65-426c04d72f51', 'volume_size': 1} Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-572416034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce5146a0-e707-4c97-ac65-426c04d72f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48dcd290f117430a864591ed66710a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:58:20Z,use_quota=True,user_id='e39e9f396f0645fba947d06e60f82b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Creating volume ce5146a0-e707-4c97-ac65-426c04d72f51 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:58:20 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:58:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ce5146a0-e707-4c97-ac65-426c04d72f51 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:20 devstack sudo[99000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ce5146a0-e707-4c97-ac65-426c04d72f51 1073741824 Nov 04 18:58:20 devstack sudo[99000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:21 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=105,cinder:INSERT=36,cinder:UPDATE=126,cinder:DELETE=13 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:58:21 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:58:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Flow 'volume_create_manager' (c1a21e6a-ee2f-4275-a4be-744a22013827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:58:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8946e7-d4e7-4301-a5a7-8bb74b42d0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8946e7-d4e7-4301-a5a7-8bb74b42d0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-104451180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10339bb1-2f37-4148-9d23-b9928f27b83b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48dcd290f117430a864591ed66710a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:58:21Z,use_quota=True,user_id='e39e9f396f0645fba947d06e60f82b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c837ca-9419-457e-8e6c-b6dcbddb110c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c837ca-9419-457e-8e6c-b6dcbddb110c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae6b37c4-a137-4fae-a9c7-22a2a03185ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae6b37c4-a137-4fae-a9c7-22a2a03185ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10339bb1-2f37-4148-9d23-b9928f27b83b', 'volume_name': 'volume-10339bb1-2f37-4148-9d23-b9928f27b83b', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ae1804-6b42-41aa-b561-c373a6faa787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ae1804-6b42-41aa-b561-c373a6faa787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b8c86c-55b5-48d4-98fc-11628e5da308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:21 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Volume 10339bb1-2f37-4148-9d23-b9928f27b83b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10339bb1-2f37-4148-9d23-b9928f27b83b', 'volume_size': 1} Nov 04 18:58:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:21 devstack sudo[99000]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ce5146a0-e707-4c97-ac65-426c04d72f51 1073741824" returned: 0 in 1.320s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ce5146a0-e707-4c97-ac65-426c04d72f51 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:22 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ce5146a0-e707-4c97-ac65-426c04d72f51 Nov 04 18:58:22 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:22 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ce5146a0-e707-4c97-ac65-426c04d72f51" returned: 0 in 0.560s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:22 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] <== create_volume: return (1997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:58:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.003s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.024s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:22 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-104451180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10339bb1-2f37-4148-9d23-b9928f27b83b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48dcd290f117430a864591ed66710a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:58:21Z,use_quota=True,user_id='e39e9f396f0645fba947d06e60f82b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:58:22 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Creating volume 10339bb1-2f37-4148-9d23-b9928f27b83b {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:58:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:22 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:58:22 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:58:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:22 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:58:22 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:58:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-10339bb1-2f37-4148-9d23-b9928f27b83b 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:22 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-10339bb1-2f37-4148-9d23-b9928f27b83b 1073741824 Nov 04 18:58:22 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e051b34-71ed-4eb1-885c-99e50aec9ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce5146a0-e707-4c97-ac65-426c04d72f51', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd60e873-b5c6-40d9-87f0-38da6bfd354b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:22 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Volume volume-ce5146a0-e707-4c97-ac65-426c04d72f51 (ce5146a0-e707-4c97-ac65-426c04d72f51): created successfully Nov 04 18:58:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd60e873-b5c6-40d9-87f0-38da6bfd354b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Flow 'volume_create_manager' (b984e134-9bf5-4a35-a351-fb884015c39a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:58:22 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-41d5287c-fde7-4683-8d31-ac5476fd26e5 tempest-TestServerVolumeAttachmentScenario-651178942 None] Created volume successfully. Nov 04 18:58:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-34c72362-9dd6-4878-bd4e-63584fb70f09 req-890cf2c8-23c1-4c74-91cb-8e3e262b343b tempest-AttachVolumeNegativeTest-722614164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:23 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-10339bb1-2f37-4148-9d23-b9928f27b83b 1073741824" returned: 0 in 0.631s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-10339bb1-2f37-4148-9d23-b9928f27b83b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:23 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-10339bb1-2f37-4148-9d23-b9928f27b83b Nov 04 18:58:23 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:23 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-10339bb1-2f37-4148-9d23-b9928f27b83b" returned: 0 in 0.474s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:23 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:58:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-34c72362-9dd6-4878-bd4e-63584fb70f09 req-890cf2c8-23c1-4c74-91cb-8e3e262b343b tempest-AttachVolumeNegativeTest-722614164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.935s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-34c72362-9dd6-4878-bd4e-63584fb70f09 req-890cf2c8-23c1-4c74-91cb-8e3e262b343b tempest-AttachVolumeNegativeTest-722614164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:23 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b8c86c-55b5-48d4-98fc-11628e5da308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10339bb1-2f37-4148-9d23-b9928f27b83b', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:23 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c07abf14-092b-4831-8054-3af1002e0aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:23 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Volume volume-10339bb1-2f37-4148-9d23-b9928f27b83b (10339bb1-2f37-4148-9d23-b9928f27b83b): created successfully Nov 04 18:58:23 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c07abf14-092b-4831-8054-3af1002e0aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:23 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Flow 'volume_create_manager' (c1a21e6a-ee2f-4275-a4be-744a22013827) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:58:24 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-34c72362-9dd6-4878-bd4e-63584fb70f09 req-890cf2c8-23c1-4c74-91cb-8e3e262b343b tempest-AttachVolumeNegativeTest-722614164 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280', 'name': 'volume-50b06aa4-a718-4d0e-a27e-dce5e0d673ed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5bd63e2c-e2d3-45b5-9647-70e2ecc9493b', 'enforce_multipath': True} {{(pid=87119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:58:24 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-a054a092-d87f-4f93-9f44-1f77545db2ce tempest-TestServerVolumeAttachmentScenario-651178942 None] Created volume successfully. Nov 04 18:58:24 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-34c72362-9dd6-4878-bd4e-63584fb70f09 req-890cf2c8-23c1-4c74-91cb-8e3e262b343b tempest-AttachVolumeNegativeTest-722614164 None] attachment_update completed successfully. Nov 04 18:58:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:58:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:58:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:58:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:25 devstack sudo[99503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:58:25 devstack sudo[99503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:25 devstack sudo[99503]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.506s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:25 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:58:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager._thread_info {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:58:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread count: 28 {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:58:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread info: [<_MainThread(MainThread, started 130247852032128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:58:27 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-8008d9ef-cedb-475f-b90b-db199ac21045 req-cc7eb768-c8a0-49d9-87ac-bb3147debd65 tempest-AttachVolumeNegativeTest-722614164 None] Terminate volume connection completed successfully. Nov 04 18:58:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-8008d9ef-cedb-475f-b90b-db199ac21045 req-cc7eb768-c8a0-49d9-87ac-bb3147debd65 tempest-AttachVolumeNegativeTest-722614164 None] Deleting attachment 5bd63e2c-e2d3-45b5-9647-70e2ecc9493b. {{(pid=87119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:58:37 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:INSERT=1,cinder:UPDATE=6,cinder:SELECT=11 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:58:37 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:UPDATE=10,cinder:SELECT=11,cinder:DELETE=2,cinder:INSERT=1 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:58:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7058f27f-2094-4a2f-8655-aa19a2956e1f tempest-VolumesNegativeTest-403211708 None] Acquiring lock "cinder-3ce0e01b-0506-41c1-bc50-56a3c2f18265-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:58:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7058f27f-2094-4a2f-8655-aa19a2956e1f tempest-VolumesNegativeTest-403211708 None] Lock "cinder-3ce0e01b-0506-41c1-bc50-56a3c2f18265-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:58:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7058f27f-2094-4a2f-8655-aa19a2956e1f tempest-VolumesNegativeTest-403211708 None] Acquiring lock "cinder-quobyte-3ce0e01b-0506-41c1-bc50-56a3c2f18265" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:58:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7058f27f-2094-4a2f-8655-aa19a2956e1f tempest-VolumesNegativeTest-403211708 None] Lock "cinder-quobyte-3ce0e01b-0506-41c1-bc50-56a3c2f18265" acquired by "delete_volume" :: waited 0.030s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:58:43 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5edd2c6-479a-465a-b82a-4df0bbadfbf7]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:58:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7058f27f-2094-4a2f-8655-aa19a2956e1f tempest-VolumesNegativeTest-403211708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3ce0e01b-0506-41c1-bc50-56a3c2f18265 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:43 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3ce0e01b-0506-41c1-bc50-56a3c2f18265 Nov 04 18:58:43 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:43 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7058f27f-2094-4a2f-8655-aa19a2956e1f tempest-VolumesNegativeTest-403211708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3ce0e01b-0506-41c1-bc50-56a3c2f18265" returned: 0 in 0.462s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7058f27f-2094-4a2f-8655-aa19a2956e1f tempest-VolumesNegativeTest-403211708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3ce0e01b-0506-41c1-bc50-56a3c2f18265 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:43 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3ce0e01b-0506-41c1-bc50-56a3c2f18265 Nov 04 18:58:43 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:43 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7058f27f-2094-4a2f-8655-aa19a2956e1f tempest-VolumesNegativeTest-403211708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3ce0e01b-0506-41c1-bc50-56a3c2f18265" returned: 0 in 0.335s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7058f27f-2094-4a2f-8655-aa19a2956e1f tempest-VolumesNegativeTest-403211708 None] Lock "cinder-quobyte-3ce0e01b-0506-41c1-bc50-56a3c2f18265" released by "delete_volume" :: held 0.878s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:58:44 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-7058f27f-2094-4a2f-8655-aa19a2956e1f tempest-VolumesNegativeTest-403211708 None] Created reservations ['94115b19-de04-464d-8a10-f09d76d38813', '9155b35a-86cd-47c0-8e51-156e9f991a53', '5390b33a-9bfb-4c7e-ab4f-500e49395846', '98a39ed3-7f91-41c9-a15c-f115ca687967'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:58:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7058f27f-2094-4a2f-8655-aa19a2956e1f tempest-VolumesNegativeTest-403211708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7058f27f-2094-4a2f-8655-aa19a2956e1f tempest-VolumesNegativeTest-403211708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:44 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7058f27f-2094-4a2f-8655-aa19a2956e1f tempest-VolumesNegativeTest-403211708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:58:44 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7058f27f-2094-4a2f-8655-aa19a2956e1f tempest-VolumesNegativeTest-403211708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:58:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7058f27f-2094-4a2f-8655-aa19a2956e1f tempest-VolumesNegativeTest-403211708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7058f27f-2094-4a2f-8655-aa19a2956e1f tempest-VolumesNegativeTest-403211708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:44 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:58:44 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:44 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7058f27f-2094-4a2f-8655-aa19a2956e1f tempest-VolumesNegativeTest-403211708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.349s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:44 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-7058f27f-2094-4a2f-8655-aa19a2956e1f tempest-VolumesNegativeTest-403211708 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:58:44 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-7058f27f-2094-4a2f-8655-aa19a2956e1f tempest-VolumesNegativeTest-403211708 None] Deleted volume successfully. Nov 04 18:58:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7058f27f-2094-4a2f-8655-aa19a2956e1f tempest-VolumesNegativeTest-403211708 None] Lock "cinder-3ce0e01b-0506-41c1-bc50-56a3c2f18265-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:58:54 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:58:54 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:UPDATE=10,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Flow 'volume_create_manager' (49df64f4-3348-46a5-9636-5eca69d1ecab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (547d08cf-1489-441a-b50d-8bc464174228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (547d08cf-1489-441a-b50d-8bc464174228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1864547144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95eb7714cb149c7868eb6ce52e1f0ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:58:55Z,use_quota=True,user_id='5f219e7fe333445db50e3c7fa278072b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7563a9e3-78c2-42e8-8cae-0f5fc5675547),volume_type_id=7563a9e3-78c2-42e8-8cae-0f5fc5675547)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a142f707-88a1-481d-96ff-90bafc84a695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a142f707-88a1-481d-96ff-90bafc84a695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5802a3bc-6579-41f1-94f1-44f958fdd572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5802a3bc-6579-41f1-94f1-44f958fdd572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f', 'volume_name': 'volume-e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f0a131-cbc9-4a78-aaf0-6e6e4ef3b792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f0a131-cbc9-4a78-aaf0-6e6e4ef3b792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7716c4fa-8891-4017-a9fe-e11c4ae0175b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:55 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Volume e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f', 'volume_size': 1} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1864547144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95eb7714cb149c7868eb6ce52e1f0ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:58:55Z,use_quota=True,user_id='5f219e7fe333445db50e3c7fa278072b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7563a9e3-78c2-42e8-8cae-0f5fc5675547),volume_type_id=7563a9e3-78c2-42e8-8cae-0f5fc5675547)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Creating volume e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:58:55 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:55 devstack sudo[99772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f 1073741824 Nov 04 18:58:55 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Flow 'volume_create_manager' (c2ebe7d8-1cac-4ac9-9e72-379c035c5d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2562c3a3-4330-44ba-b01c-eb2f61d872fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2562c3a3-4330-44ba-b01c-eb2f61d872fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1495840168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27800128-6406-44a9-915c-3ba3b714b4f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95eb7714cb149c7868eb6ce52e1f0ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:58:55Z,use_quota=True,user_id='5f219e7fe333445db50e3c7fa278072b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0305c659-e05a-48f1-9adc-0717ad720e0e),volume_type_id=0305c659-e05a-48f1-9adc-0717ad720e0e)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c2ad51a-0e84-43b4-9950-7c79acba5215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c2ad51a-0e84-43b4-9950-7c79acba5215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50c6d61-a994-4485-b3e4-d00ed1952b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50c6d61-a994-4485-b3e4-d00ed1952b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27800128-6406-44a9-915c-3ba3b714b4f4', 'volume_name': 'volume-27800128-6406-44a9-915c-3ba3b714b4f4', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ccb1bf-7ebb-4e47-94fb-2ca7b532184b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ccb1bf-7ebb-4e47-94fb-2ca7b532184b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55259557-4ba0-4520-9da4-1677fb557961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:55 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Volume 27800128-6406-44a9-915c-3ba3b714b4f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27800128-6406-44a9-915c-3ba3b714b4f4', 'volume_size': 1} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:55 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f 1073741824" returned: 0 in 0.673s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:55 devstack sudo[99779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f Nov 04 18:58:55 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:56 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f" returned: 0 in 0.338s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:56 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:58:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.575s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:56 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1495840168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27800128-6406-44a9-915c-3ba3b714b4f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95eb7714cb149c7868eb6ce52e1f0ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:58:55Z,use_quota=True,user_id='5f219e7fe333445db50e3c7fa278072b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0305c659-e05a-48f1-9adc-0717ad720e0e),volume_type_id=0305c659-e05a-48f1-9adc-0717ad720e0e)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:58:56 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Creating volume 27800128-6406-44a9-915c-3ba3b714b4f4 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:58:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:56 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:58:56 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:58:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:56 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:58:56 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:58:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-27800128-6406-44a9-915c-3ba3b714b4f4 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7716c4fa-8891-4017-a9fe-e11c4ae0175b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6350133-cda9-4271-a42c-a1d38fba0096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:56 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-27800128-6406-44a9-915c-3ba3b714b4f4 1073741824 Nov 04 18:58:56 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:56 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Volume volume-e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f (e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f): created successfully Nov 04 18:58:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6350133-cda9-4271-a42c-a1d38fba0096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Flow 'volume_create_manager' (49df64f4-3348-46a5-9636-5eca69d1ecab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:58:56 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-babf3c44-9056-460c-b6f5-40312e48bfa8 tempest-TestInstancesWithCinderVolumes-797267290 None] Created volume successfully. Nov 04 18:58:56 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:58:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Flow 'volume_create_manager' (3110fd3f-45d7-427f-a0ef-1029bb172bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:58:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74b6cee7-46e5-4648-8eeb-98cc44a3c798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74b6cee7-46e5-4648-8eeb-98cc44a3c798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-985693972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9acb2c9-7e09-4bd3-8741-9e51db82f1c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95eb7714cb149c7868eb6ce52e1f0ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:58:56Z,use_quota=True,user_id='5f219e7fe333445db50e3c7fa278072b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dece4420-cbe1-4ff8-a8c3-3695ab716964),volume_type_id=dece4420-cbe1-4ff8-a8c3-3695ab716964)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f80df675-58f7-4795-a9f6-f6aac80796c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f80df675-58f7-4795-a9f6-f6aac80796c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e98a811-d780-43f7-afd5-2ed360df4cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:56 devstack cinder-volume[87119]: DEBUG cinder.image.glance [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Creating Keystone auth plugin from conf {{(pid=87119) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 18:58:56 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-27800128-6406-44a9-915c-3ba3b714b4f4 1073741824" returned: 0 in 0.673s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-27800128-6406-44a9-915c-3ba3b714b4f4 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:57 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-27800128-6406-44a9-915c-3ba3b714b4f4 Nov 04 18:58:57 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e98a811-d780-43f7-afd5-2ed360df4cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a9acb2c9-7e09-4bd3-8741-9e51db82f1c9', 'volume_name': 'volume-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9', 'volume_size': 1, 'image_id': 'ee7d2d54-b5fe-4a03-84ad-2e4534062aa4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee7d2d54-b5fe-4a03-84ad-2e4534062aa4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--867015466', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e95eb7714cb149c7868eb6ce52e1f0ea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ee7d2d54-b5fe-4a03-84ad-2e4534062aa4', 'created_at': datetime.datetime(2026, 11, 4, 17, 58, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee7d2d54-b5fe-4a03-84ad-2e4534062aa4/file', 'properties': {}}, 'image_service': }' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b024d116-78ab-4697-bcf7-78b5d75255ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b024d116-78ab-4697-bcf7-78b5d75255ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c9e73c-c474-4c33-8e0f-85666bb1adbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:57 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Volume a9acb2c9-7e09-4bd3-8741-9e51db82f1c9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9', 'volume_size': 1, 'image_id': 'ee7d2d54-b5fe-4a03-84ad-2e4534062aa4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee7d2d54-b5fe-4a03-84ad-2e4534062aa4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--867015466', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e95eb7714cb149c7868eb6ce52e1f0ea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ee7d2d54-b5fe-4a03-84ad-2e4534062aa4', 'created_at': datetime.datetime(2026, 11, 4, 17, 58, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee7d2d54-b5fe-4a03-84ad-2e4534062aa4/file', 'properties': {}}, 'image_service': } Nov 04 18:58:57 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Trying to clone a9acb2c9-7e09-4bd3-8741-9e51db82f1c9 from image ee7d2d54-b5fe-4a03-84ad-2e4534062aa4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ee7d2d54-b5fe-4a03-84ad-2e4534062aa4', 'metadata': {}}]). {{(pid=87119) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 18:58:57 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-27800128-6406-44a9-915c-3ba3b714b4f4" returned: 0 in 0.418s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:58:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55259557-4ba0-4520-9da4-1677fb557961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27800128-6406-44a9-915c-3ba3b714b4f4', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1001cab4-fd48-4bab-8349-36490198e938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:57 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Volume volume-27800128-6406-44a9-915c-3ba3b714b4f4 (27800128-6406-44a9-915c-3ba3b714b4f4): created successfully Nov 04 18:58:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1001cab4-fd48-4bab-8349-36490198e938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Flow 'volume_create_manager' (c2ebe7d8-1cac-4ac9-9e72-379c035c5d50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:58:57 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-2dbe40c5-8e03-4bf8-91d7-d56e5b4dc333 tempest-TestInstancesWithCinderVolumes-797267290 None] Created volume successfully. Nov 04 18:59:03 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ee7d2d54-b5fe-4a03-84ad-2e4534062aa4_xsewn4f2devstack@QuobyteHD, size 20.69 MB, duration 5.88 sec {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 18:59:03 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Image download 20.69 MB at 3.52 MB/s Nov 04 18:59:03 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[effd9b43-e079-45e6-8c84-368480cc1241]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:59:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee7d2d54-b5fe-4a03-84ad-2e4534062aa4_xsewn4f2devstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:03 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee7d2d54-b5fe-4a03-84ad-2e4534062aa4_xsewn4f2devstack@QuobyteHD Nov 04 18:59:03 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:03 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee7d2d54-b5fe-4a03-84ad-2e4534062aa4_xsewn4f2devstack@QuobyteHD" returned: 0 in 0.427s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:03 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Temporary image ee7d2d54-b5fe-4a03-84ad-2e4534062aa4 is fetched for user 5f219e7fe333445db50e3c7fa278072b. {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 18:59:03 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c699840-c064-4818-8a7d-a9f79186b274]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:59:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee7d2d54-b5fe-4a03-84ad-2e4534062aa4_xsewn4f2devstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:03 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee7d2d54-b5fe-4a03-84ad-2e4534062aa4_xsewn4f2devstack@QuobyteHD Nov 04 18:59:03 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:04 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee7d2d54-b5fe-4a03-84ad-2e4534062aa4_xsewn4f2devstack@QuobyteHD" returned: 0 in 0.521s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:04 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-985693972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9acb2c9-7e09-4bd3-8741-9e51db82f1c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95eb7714cb149c7868eb6ce52e1f0ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:58:56Z,use_quota=True,user_id='5f219e7fe333445db50e3c7fa278072b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dece4420-cbe1-4ff8-a8c3-3695ab716964),volume_type_id=dece4420-cbe1-4ff8-a8c3-3695ab716964)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:59:04 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Creating volume a9acb2c9-7e09-4bd3-8741-9e51db82f1c9 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:59:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:04 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:59:04 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:59:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:04 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:59:04 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:59:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:04 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9 1073741824 Nov 04 18:59:04 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:04 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9 1073741824" returned: 0 in 0.718s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:05 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9 Nov 04 18:59:05 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:05 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9" returned: 0 in 0.380s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:59:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:05 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Attempting download of ee7d2d54-b5fe-4a03-84ad-2e4534062aa4 ((None, [{'url': 'file:///opt/stack/data/glance/images/ee7d2d54-b5fe-4a03-84ad-2e4534062aa4', 'metadata': {}}])) to volume a9acb2c9-7e09-4bd3-8741-9e51db82f1c9. {{(pid=87119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 18:59:05 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2cc855-b038-47a6-9310-6b8933cd4546]: (4, 'raw') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:59:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee7d2d54-b5fe-4a03-84ad-2e4534062aa4_ibak9sq9 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:05 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee7d2d54-b5fe-4a03-84ad-2e4534062aa4_ibak9sq9 Nov 04 18:59:05 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:06 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee7d2d54-b5fe-4a03-84ad-2e4534062aa4_ibak9sq9" returned: 0 in 0.639s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee7d2d54-b5fe-4a03-84ad-2e4534062aa4_ibak9sq9 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:06 devstack sudo[99892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee7d2d54-b5fe-4a03-84ad-2e4534062aa4_ibak9sq9 Nov 04 18:59:06 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:06 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee7d2d54-b5fe-4a03-84ad-2e4534062aa4_ibak9sq9" returned: 1 in 0.423s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee7d2d54-b5fe-4a03-84ad-2e4534062aa4_ibak9sq9' failed. Not Retrying. {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 18:59:06 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed591894-0f25-4379-b97b-57aa8448a5b9]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:59:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee7d2d54-b5fe-4a03-84ad-2e4534062aa4_xsewn4f2devstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:06 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee7d2d54-b5fe-4a03-84ad-2e4534062aa4_xsewn4f2devstack@QuobyteHD Nov 04 18:59:06 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:07 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee7d2d54-b5fe-4a03-84ad-2e4534062aa4_xsewn4f2devstack@QuobyteHD" returned: 0 in 0.493s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:07 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] ee7d2d54-b5fe-4a03-84ad-2e4534062aa4 was qcow2, converting to qcow2 {{(pid=87119) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 18:59:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ee7d2d54-b5fe-4a03-84ad-2e4534062aa4_xsewn4f2devstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:07 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ee7d2d54-b5fe-4a03-84ad-2e4534062aa4_xsewn4f2devstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9 Nov 04 18:59:07 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-327d11c1-983d-4b0f-9fb6-310cdbeb515f req-65a8bfe9-1a0d-4592-bdea-70850d3506fa tempest-TestServerVolumeAttachmentScenario-651178942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-327d11c1-983d-4b0f-9fb6-310cdbeb515f req-65a8bfe9-1a0d-4592-bdea-70850d3506fa tempest-TestServerVolumeAttachmentScenario-651178942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-327d11c1-983d-4b0f-9fb6-310cdbeb515f req-65a8bfe9-1a0d-4592-bdea-70850d3506fa tempest-TestServerVolumeAttachmentScenario-651178942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-327d11c1-983d-4b0f-9fb6-310cdbeb515f req-65a8bfe9-1a0d-4592-bdea-70850d3506fa tempest-TestServerVolumeAttachmentScenario-651178942 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280', 'name': 'volume-ce5146a0-e707-4c97-ac65-426c04d72f51', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a8531e00-811a-4e67-8cb0-e040200a2afa', 'enforce_multipath': True} {{(pid=87119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:59:08 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-327d11c1-983d-4b0f-9fb6-310cdbeb515f req-65a8bfe9-1a0d-4592-bdea-70850d3506fa tempest-TestServerVolumeAttachmentScenario-651178942 None] attachment_update completed successfully. Nov 04 18:59:09 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ee7d2d54-b5fe-4a03-84ad-2e4534062aa4_xsewn4f2devstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9" returned: 0 in 2.841s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:09 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ee7d2d54-b5fe-4a03-84ad-2e4534062aa4_xsewn4f2devstack@QuobyteHD, size 112.00 MB, duration 2.84 sec, destination /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9 {{(pid=87119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 18:59:09 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Converted 112.00 MB image at 39.41 MB/s Nov 04 18:59:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:09 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9 1G Nov 04 18:59:09 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:10 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9 1G" returned: 0 in 0.419s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:10 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Downloaded image ee7d2d54-b5fe-4a03-84ad-2e4534062aa4 ((None, [{'url': 'file:///opt/stack/data/glance/images/ee7d2d54-b5fe-4a03-84ad-2e4534062aa4', 'metadata': {}}])) to volume a9acb2c9-7e09-4bd3-8741-9e51db82f1c9 successfully. {{(pid=87119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 18:59:10 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Temporary image ee7d2d54-b5fe-4a03-84ad-2e4534062aa4 for user 5f219e7fe333445db50e3c7fa278072b is deleted. {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 18:59:10 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Marking volume a9acb2c9-7e09-4bd3-8741-9e51db82f1c9 as bootable. {{(pid=87119) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 18:59:10 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Copying metadata from image ee7d2d54-b5fe-4a03-84ad-2e4534062aa4 to a9acb2c9-7e09-4bd3-8741-9e51db82f1c9. {{(pid=87119) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 18:59:10 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Creating volume glance metadata for volume a9acb2c9-7e09-4bd3-8741-9e51db82f1c9 backed by image ee7d2d54-b5fe-4a03-84ad-2e4534062aa4 with: {'image_id': 'ee7d2d54-b5fe-4a03-84ad-2e4534062aa4', 'image_name': 'tempest-scenario-img--867015466', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87119) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 18:59:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c9e73c-c474-4c33-8e0f-85666bb1adbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9', 'volume_size': 1, 'image_id': 'ee7d2d54-b5fe-4a03-84ad-2e4534062aa4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee7d2d54-b5fe-4a03-84ad-2e4534062aa4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--867015466', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e95eb7714cb149c7868eb6ce52e1f0ea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ee7d2d54-b5fe-4a03-84ad-2e4534062aa4', 'created_at': datetime.datetime(2026, 11, 4, 17, 58, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 58, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee7d2d54-b5fe-4a03-84ad-2e4534062aa4/file', 'properties': {}}, 'image_service': }' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc45f8a0-bf3a-4716-859e-f8cebafdd66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:10 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Volume volume-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9 (a9acb2c9-7e09-4bd3-8741-9e51db82f1c9): created successfully Nov 04 18:59:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc45f8a0-bf3a-4716-859e-f8cebafdd66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Flow 'volume_create_manager' (3110fd3f-45d7-427f-a0ef-1029bb172bab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:59:10 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-cb0a886f-ee42-48a2-af31-e14a2fa383e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Created volume successfully. Nov 04 18:59:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-3274b4b0-09e1-477d-8c59-fb847ae34493 req-f0701789-75e1-4189-8104-a3f37df88efc tempest-TestServerVolumeAttachmentScenario-651178942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-3274b4b0-09e1-477d-8c59-fb847ae34493 req-f0701789-75e1-4189-8104-a3f37df88efc tempest-TestServerVolumeAttachmentScenario-651178942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-3274b4b0-09e1-477d-8c59-fb847ae34493 req-f0701789-75e1-4189-8104-a3f37df88efc tempest-TestServerVolumeAttachmentScenario-651178942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-3274b4b0-09e1-477d-8c59-fb847ae34493 req-f0701789-75e1-4189-8104-a3f37df88efc tempest-TestServerVolumeAttachmentScenario-651178942 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280', 'name': 'volume-10339bb1-2f37-4148-9d23-b9928f27b83b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53c76257-6cbd-42da-89e3-0ef21644fec3', 'enforce_multipath': True} {{(pid=87119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:59:14 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-3274b4b0-09e1-477d-8c59-fb847ae34493 req-f0701789-75e1-4189-8104-a3f37df88efc tempest-TestServerVolumeAttachmentScenario-651178942 None] attachment_update completed successfully. Nov 04 18:59:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-3a394d74-e5e1-493d-867f-b3ef84bd5739 req-1b2e8f24-3be0-4261-8dcd-2184682d95e0 tempest-TestInstancesWithCinderVolumes-797267290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-3a394d74-e5e1-493d-867f-b3ef84bd5739 req-1b2e8f24-3be0-4261-8dcd-2184682d95e0 tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-3a394d74-e5e1-493d-867f-b3ef84bd5739 req-1b2e8f24-3be0-4261-8dcd-2184682d95e0 tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:15 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-3a394d74-e5e1-493d-867f-b3ef84bd5739 req-1b2e8f24-3be0-4261-8dcd-2184682d95e0 tempest-TestInstancesWithCinderVolumes-797267290 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280', 'name': 'volume-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b754a622-538b-4935-a6ec-6bd58b6dcd60', 'enforce_multipath': True} {{(pid=87119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:59:15 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-3a394d74-e5e1-493d-867f-b3ef84bd5739 req-1b2e8f24-3be0-4261-8dcd-2184682d95e0 tempest-TestInstancesWithCinderVolumes-797267290 None] attachment_update completed successfully. Nov 04 18:59:17 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-ded0a815-a809-4920-85ba-929425ef2f09 req-6234bde3-a78b-4584-852b-8e47ab23b883 tempest-TestServerVolumeAttachmentScenario-651178942 None] Terminate volume connection completed successfully. Nov 04 18:59:17 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-ded0a815-a809-4920-85ba-929425ef2f09 req-6234bde3-a78b-4584-852b-8e47ab23b883 tempest-TestServerVolumeAttachmentScenario-651178942 None] Deleting attachment 53c76257-6cbd-42da-89e3-0ef21644fec3. {{(pid=87119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:59:18 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-c40657cd-cc5b-44a0-9b59-e17eda9c85a1 req-7462e813-7a9d-42f7-99f4-cf0fa7e437fa tempest-TestServerVolumeAttachmentScenario-651178942 None] Terminate volume connection completed successfully. Nov 04 18:59:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-c40657cd-cc5b-44a0-9b59-e17eda9c85a1 req-7462e813-7a9d-42f7-99f4-cf0fa7e437fa tempest-TestServerVolumeAttachmentScenario-651178942 None] Deleting attachment a8531e00-811a-4e67-8cb0-e040200a2afa. {{(pid=87119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:25 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:59:25 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Flow 'volume_create_manager' (bde434c8-4ac1-4689-a932-e818ce13c5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a1d53d-ee8c-4210-83ae-7ba05cef77b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a1d53d-ee8c-4210-83ae-7ba05cef77b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-87274789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4924e6b7-c30a-49a8-baad-bb0a1709fa41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a89143e489b846c68d02b2c99b97d011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:59:25Z,use_quota=True,user_id='2df3cb21008e46d48baecb25ef9390f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1589ca4-90af-4559-8c52-131b76cbd4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1589ca4-90af-4559-8c52-131b76cbd4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35f53e7e-6378-4441-becb-76a1dea05a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35f53e7e-6378-4441-becb-76a1dea05a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4924e6b7-c30a-49a8-baad-bb0a1709fa41', 'volume_name': 'volume-4924e6b7-c30a-49a8-baad-bb0a1709fa41', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ae3bdc-6e9b-412d-bf88-11e1d25dc2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ae3bdc-6e9b-412d-bf88-11e1d25dc2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d180cdc7-c7f5-4d02-ad10-8ca7e4ca3326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:25 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Volume 4924e6b7-c30a-49a8-baad-bb0a1709fa41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4924e6b7-c30a-49a8-baad-bb0a1709fa41', 'volume_size': 1} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-87274789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4924e6b7-c30a-49a8-baad-bb0a1709fa41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a89143e489b846c68d02b2c99b97d011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:59:25Z,use_quota=True,user_id='2df3cb21008e46d48baecb25ef9390f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Creating volume 4924e6b7-c30a-49a8-baad-bb0a1709fa41 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:59:25 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4924e6b7-c30a-49a8-baad-bb0a1709fa41 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:25 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4924e6b7-c30a-49a8-baad-bb0a1709fa41 1073741824 Nov 04 18:59:25 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:25 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.376s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager._thread_info {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread count: 28 {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:59:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread info: [<_MainThread(MainThread, started 130247852032128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:59:26 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4924e6b7-c30a-49a8-baad-bb0a1709fa41 1073741824" returned: 0 in 0.950s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4924e6b7-c30a-49a8-baad-bb0a1709fa41 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:26 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4924e6b7-c30a-49a8-baad-bb0a1709fa41 Nov 04 18:59:26 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:26 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4924e6b7-c30a-49a8-baad-bb0a1709fa41" returned: 0 in 0.341s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:59:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:26 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-623c642d-d2ab-4782-9abc-806fae8be474 tempest-TestServerVolumeAttachmentScenario-651178942 None] Acquiring lock "cinder-10339bb1-2f37-4148-9d23-b9928f27b83b-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:59:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d180cdc7-c7f5-4d02-ad10-8ca7e4ca3326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4924e6b7-c30a-49a8-baad-bb0a1709fa41', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (861b56f4-9951-49c8-ad7a-049772f67861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:26 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-623c642d-d2ab-4782-9abc-806fae8be474 tempest-TestServerVolumeAttachmentScenario-651178942 None] Lock "cinder-10339bb1-2f37-4148-9d23-b9928f27b83b-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:59:27 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Volume volume-4924e6b7-c30a-49a8-baad-bb0a1709fa41 (4924e6b7-c30a-49a8-baad-bb0a1709fa41): created successfully Nov 04 18:59:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (861b56f4-9951-49c8-ad7a-049772f67861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Flow 'volume_create_manager' (bde434c8-4ac1-4689-a932-e818ce13c5bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:59:27 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-0ba695ce-ac14-43b3-9f9f-53055eb0e96b tempest-AttachVolumeNegativeTest-722614164 None] Created volume successfully. Nov 04 18:59:27 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-623c642d-d2ab-4782-9abc-806fae8be474 tempest-TestServerVolumeAttachmentScenario-651178942 None] Acquiring lock "cinder-quobyte-10339bb1-2f37-4148-9d23-b9928f27b83b" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:59:27 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-623c642d-d2ab-4782-9abc-806fae8be474 tempest-TestServerVolumeAttachmentScenario-651178942 None] Lock "cinder-quobyte-10339bb1-2f37-4148-9d23-b9928f27b83b" acquired by "delete_volume" :: waited 0.031s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:59:27 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[078983d0-6ce1-4052-9d0e-66fa73260fee]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:59:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-623c642d-d2ab-4782-9abc-806fae8be474 tempest-TestServerVolumeAttachmentScenario-651178942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-10339bb1-2f37-4148-9d23-b9928f27b83b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:27 devstack sudo[100958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-10339bb1-2f37-4148-9d23-b9928f27b83b Nov 04 18:59:27 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:28 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-623c642d-d2ab-4782-9abc-806fae8be474 tempest-TestServerVolumeAttachmentScenario-651178942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-10339bb1-2f37-4148-9d23-b9928f27b83b" returned: 0 in 1.061s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-623c642d-d2ab-4782-9abc-806fae8be474 tempest-TestServerVolumeAttachmentScenario-651178942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-10339bb1-2f37-4148-9d23-b9928f27b83b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:28 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-10339bb1-2f37-4148-9d23-b9928f27b83b Nov 04 18:59:28 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:29 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-623c642d-d2ab-4782-9abc-806fae8be474 tempest-TestServerVolumeAttachmentScenario-651178942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-10339bb1-2f37-4148-9d23-b9928f27b83b" returned: 0 in 0.863s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:29 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-623c642d-d2ab-4782-9abc-806fae8be474 tempest-TestServerVolumeAttachmentScenario-651178942 None] Lock "cinder-quobyte-10339bb1-2f37-4148-9d23-b9928f27b83b" released by "delete_volume" :: held 1.999s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:59:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-7f7846e5-e9e2-433d-993e-386da26c1db3 req-70db34dd-1a5a-4ac5-872e-3aef8d3e19ff tempest-AttachVolumeNegativeTest-722614164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-7f7846e5-e9e2-433d-993e-386da26c1db3 req-70db34dd-1a5a-4ac5-872e-3aef8d3e19ff tempest-AttachVolumeNegativeTest-722614164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:29 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-623c642d-d2ab-4782-9abc-806fae8be474 tempest-TestServerVolumeAttachmentScenario-651178942 None] Created reservations ['9e19cf12-5ed9-406d-9c72-d1273582a4ba', '87d91c29-40f9-405b-928a-6070bdcbea1d', 'a5d1b77a-9c33-4a32-b4c1-5863874cd487', '628a76d0-0850-42f6-bb09-ff946df7e2bd'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:59:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-7f7846e5-e9e2-433d-993e-386da26c1db3 req-70db34dd-1a5a-4ac5-872e-3aef8d3e19ff tempest-AttachVolumeNegativeTest-722614164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.055s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-7f7846e5-e9e2-433d-993e-386da26c1db3 req-70db34dd-1a5a-4ac5-872e-3aef8d3e19ff tempest-AttachVolumeNegativeTest-722614164 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280', 'name': 'volume-4924e6b7-c30a-49a8-baad-bb0a1709fa41', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '35644b4a-cebb-4104-8a7a-0b8b7c41bc5c', 'enforce_multipath': True} {{(pid=87119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:59:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-623c642d-d2ab-4782-9abc-806fae8be474 tempest-TestServerVolumeAttachmentScenario-651178942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-623c642d-d2ab-4782-9abc-806fae8be474 tempest-TestServerVolumeAttachmentScenario-651178942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-623c642d-d2ab-4782-9abc-806fae8be474 tempest-TestServerVolumeAttachmentScenario-651178942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:59:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-623c642d-d2ab-4782-9abc-806fae8be474 tempest-TestServerVolumeAttachmentScenario-651178942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:59:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-623c642d-d2ab-4782-9abc-806fae8be474 tempest-TestServerVolumeAttachmentScenario-651178942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-623c642d-d2ab-4782-9abc-806fae8be474 tempest-TestServerVolumeAttachmentScenario-651178942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:29 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:59:29 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:29 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-7f7846e5-e9e2-433d-993e-386da26c1db3 req-70db34dd-1a5a-4ac5-872e-3aef8d3e19ff tempest-AttachVolumeNegativeTest-722614164 None] attachment_update completed successfully. Nov 04 18:59:30 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-623c642d-d2ab-4782-9abc-806fae8be474 tempest-TestServerVolumeAttachmentScenario-651178942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.581s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:30 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-623c642d-d2ab-4782-9abc-806fae8be474 tempest-TestServerVolumeAttachmentScenario-651178942 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:59:30 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-623c642d-d2ab-4782-9abc-806fae8be474 tempest-TestServerVolumeAttachmentScenario-651178942 None] Deleted volume successfully. Nov 04 18:59:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-623c642d-d2ab-4782-9abc-806fae8be474 tempest-TestServerVolumeAttachmentScenario-651178942 None] Lock "cinder-10339bb1-2f37-4148-9d23-b9928f27b83b-delete_volume" released by "delete_volume" :: held 3.271s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:59:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3e374eb4-ecd2-4fb3-8aac-912e52110807 tempest-TestServerVolumeAttachmentScenario-651178942 None] Acquiring lock "cinder-ce5146a0-e707-4c97-ac65-426c04d72f51-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:59:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3e374eb4-ecd2-4fb3-8aac-912e52110807 tempest-TestServerVolumeAttachmentScenario-651178942 None] Lock "cinder-ce5146a0-e707-4c97-ac65-426c04d72f51-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:59:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3e374eb4-ecd2-4fb3-8aac-912e52110807 tempest-TestServerVolumeAttachmentScenario-651178942 None] Acquiring lock "cinder-quobyte-ce5146a0-e707-4c97-ac65-426c04d72f51" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:59:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3e374eb4-ecd2-4fb3-8aac-912e52110807 tempest-TestServerVolumeAttachmentScenario-651178942 None] Lock "cinder-quobyte-ce5146a0-e707-4c97-ac65-426c04d72f51" acquired by "delete_volume" :: waited 0.035s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:59:30 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6796c7b-7bd8-4715-bfe7-59c02b98ee39]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:59:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3e374eb4-ecd2-4fb3-8aac-912e52110807 tempest-TestServerVolumeAttachmentScenario-651178942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ce5146a0-e707-4c97-ac65-426c04d72f51 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:31 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ce5146a0-e707-4c97-ac65-426c04d72f51 Nov 04 18:59:31 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:31 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3e374eb4-ecd2-4fb3-8aac-912e52110807 tempest-TestServerVolumeAttachmentScenario-651178942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ce5146a0-e707-4c97-ac65-426c04d72f51" returned: 0 in 1.112s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3e374eb4-ecd2-4fb3-8aac-912e52110807 tempest-TestServerVolumeAttachmentScenario-651178942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ce5146a0-e707-4c97-ac65-426c04d72f51 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:31 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ce5146a0-e707-4c97-ac65-426c04d72f51 Nov 04 18:59:31 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:32 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3e374eb4-ecd2-4fb3-8aac-912e52110807 tempest-TestServerVolumeAttachmentScenario-651178942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ce5146a0-e707-4c97-ac65-426c04d72f51" returned: 0 in 0.645s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:32 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3e374eb4-ecd2-4fb3-8aac-912e52110807 tempest-TestServerVolumeAttachmentScenario-651178942 None] Lock "cinder-quobyte-ce5146a0-e707-4c97-ac65-426c04d72f51" released by "delete_volume" :: held 1.895s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:59:32 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-3e374eb4-ecd2-4fb3-8aac-912e52110807 tempest-TestServerVolumeAttachmentScenario-651178942 None] Created reservations ['fa4586e0-514b-4b03-b6c6-611ac2b00c29', 'fca901d7-d820-4d49-ad46-a46c83e8d812', '118b2466-beef-4c55-8af2-caf7416391ec', '42507540-6733-4916-8d96-48859746b536'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:59:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3e374eb4-ecd2-4fb3-8aac-912e52110807 tempest-TestServerVolumeAttachmentScenario-651178942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3e374eb4-ecd2-4fb3-8aac-912e52110807 tempest-TestServerVolumeAttachmentScenario-651178942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3e374eb4-ecd2-4fb3-8aac-912e52110807 tempest-TestServerVolumeAttachmentScenario-651178942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:59:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3e374eb4-ecd2-4fb3-8aac-912e52110807 tempest-TestServerVolumeAttachmentScenario-651178942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:59:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3e374eb4-ecd2-4fb3-8aac-912e52110807 tempest-TestServerVolumeAttachmentScenario-651178942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3e374eb4-ecd2-4fb3-8aac-912e52110807 tempest-TestServerVolumeAttachmentScenario-651178942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:32 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:59:32 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:33 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-baff44f4-8c78-42fd-b29b-6da6b93b2890 req-28805081-17d2-4b5d-bb88-3951fccb0a79 tempest-AttachVolumeNegativeTest-722614164 None] Terminate volume connection completed successfully. Nov 04 18:59:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-baff44f4-8c78-42fd-b29b-6da6b93b2890 req-28805081-17d2-4b5d-bb88-3951fccb0a79 tempest-AttachVolumeNegativeTest-722614164 None] Deleting attachment 35644b4a-cebb-4104-8a7a-0b8b7c41bc5c. {{(pid=87119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:59:33 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3e374eb4-ecd2-4fb3-8aac-912e52110807 tempest-TestServerVolumeAttachmentScenario-651178942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.940s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:33 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-3e374eb4-ecd2-4fb3-8aac-912e52110807 tempest-TestServerVolumeAttachmentScenario-651178942 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:59:33 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-3e374eb4-ecd2-4fb3-8aac-912e52110807 tempest-TestServerVolumeAttachmentScenario-651178942 None] Deleted volume successfully. Nov 04 18:59:33 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3e374eb4-ecd2-4fb3-8aac-912e52110807 tempest-TestServerVolumeAttachmentScenario-651178942 None] Lock "cinder-ce5146a0-e707-4c97-ac65-426c04d72f51-delete_volume" released by "delete_volume" :: held 3.337s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:59:42 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:UPDATE=29,cinder:SELECT=59,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:59:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9262fc84-dee5-4b0b-b39b-3dc079c3646e tempest-AttachVolumeNegativeTest-722614164 None] Acquiring lock "cinder-4924e6b7-c30a-49a8-baad-bb0a1709fa41-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:59:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9262fc84-dee5-4b0b-b39b-3dc079c3646e tempest-AttachVolumeNegativeTest-722614164 None] Lock "cinder-4924e6b7-c30a-49a8-baad-bb0a1709fa41-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:59:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9262fc84-dee5-4b0b-b39b-3dc079c3646e tempest-AttachVolumeNegativeTest-722614164 None] Acquiring lock "cinder-quobyte-4924e6b7-c30a-49a8-baad-bb0a1709fa41" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:59:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9262fc84-dee5-4b0b-b39b-3dc079c3646e tempest-AttachVolumeNegativeTest-722614164 None] Lock "cinder-quobyte-4924e6b7-c30a-49a8-baad-bb0a1709fa41" acquired by "delete_volume" :: waited 0.059s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:59:43 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bba981-ce39-47ea-a9ad-e4be5cdb947a]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:59:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9262fc84-dee5-4b0b-b39b-3dc079c3646e tempest-AttachVolumeNegativeTest-722614164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4924e6b7-c30a-49a8-baad-bb0a1709fa41 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:44 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4924e6b7-c30a-49a8-baad-bb0a1709fa41 Nov 04 18:59:44 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:44 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9262fc84-dee5-4b0b-b39b-3dc079c3646e tempest-AttachVolumeNegativeTest-722614164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4924e6b7-c30a-49a8-baad-bb0a1709fa41" returned: 0 in 0.835s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9262fc84-dee5-4b0b-b39b-3dc079c3646e tempest-AttachVolumeNegativeTest-722614164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4924e6b7-c30a-49a8-baad-bb0a1709fa41 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:44 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4924e6b7-c30a-49a8-baad-bb0a1709fa41 Nov 04 18:59:44 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:45 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9262fc84-dee5-4b0b-b39b-3dc079c3646e tempest-AttachVolumeNegativeTest-722614164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4924e6b7-c30a-49a8-baad-bb0a1709fa41" returned: 0 in 0.660s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9262fc84-dee5-4b0b-b39b-3dc079c3646e tempest-AttachVolumeNegativeTest-722614164 None] Lock "cinder-quobyte-4924e6b7-c30a-49a8-baad-bb0a1709fa41" released by "delete_volume" :: held 1.590s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Flow 'volume_create_manager' (7ce1baa8-a89a-481d-9c69-15525e029bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b5dfc53-d6b6-4283-929c-ed685cafd6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b5dfc53-d6b6-4283-929c-ed685cafd6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-636878979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb15badb-1d5e-4471-81fe-46545ea48f92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78afaef7a3ce4a638a9f58a147ea388d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:59:45Z,use_quota=True,user_id='ccbf4a7ec83c42459d294a5b04ea44af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9921f25f-f6f8-4412-8018-8e77b78fc997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9921f25f-f6f8-4412-8018-8e77b78fc997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2af927d-2b63-4c7f-910c-2ecd81abab9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2af927d-2b63-4c7f-910c-2ecd81abab9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb15badb-1d5e-4471-81fe-46545ea48f92', 'volume_name': 'volume-bb15badb-1d5e-4471-81fe-46545ea48f92', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f8f086-8af6-486d-9b1c-bb39d24aa26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f8f086-8af6-486d-9b1c-bb39d24aa26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d4088f-bd89-4a8a-80e9-1501755db547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:45 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Volume bb15badb-1d5e-4471-81fe-46545ea48f92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb15badb-1d5e-4471-81fe-46545ea48f92', 'volume_size': 1} Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-636878979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb15badb-1d5e-4471-81fe-46545ea48f92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78afaef7a3ce4a638a9f58a147ea388d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:59:45Z,use_quota=True,user_id='ccbf4a7ec83c42459d294a5b04ea44af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Creating volume bb15badb-1d5e-4471-81fe-46545ea48f92 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:59:45 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bb15badb-1d5e-4471-81fe-46545ea48f92 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-9262fc84-dee5-4b0b-b39b-3dc079c3646e tempest-AttachVolumeNegativeTest-722614164 None] Created reservations ['65925ae6-8d82-4d0e-8441-e4616ddaac90', 'd7df0417-60e8-4d41-a684-4baf2ad828b8', 'c2ef545c-478a-4eb8-b31e-595f1bbd987c', '0f75b471-c597-426e-b2f8-cc83250d2b1c'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:59:45 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bb15badb-1d5e-4471-81fe-46545ea48f92 1073741824 Nov 04 18:59:45 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9262fc84-dee5-4b0b-b39b-3dc079c3646e tempest-AttachVolumeNegativeTest-722614164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9262fc84-dee5-4b0b-b39b-3dc079c3646e tempest-AttachVolumeNegativeTest-722614164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9262fc84-dee5-4b0b-b39b-3dc079c3646e tempest-AttachVolumeNegativeTest-722614164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9262fc84-dee5-4b0b-b39b-3dc079c3646e tempest-AttachVolumeNegativeTest-722614164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9262fc84-dee5-4b0b-b39b-3dc079c3646e tempest-AttachVolumeNegativeTest-722614164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9262fc84-dee5-4b0b-b39b-3dc079c3646e tempest-AttachVolumeNegativeTest-722614164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:46 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:59:46 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e818bb51-13f2-4f93-a7fe-55aa1652a44d tempest-AttachVolumeNegativeTest-722614164 None] Acquiring lock "cinder-50b06aa4-a718-4d0e-a27e-dce5e0d673ed-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:59:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e818bb51-13f2-4f93-a7fe-55aa1652a44d tempest-AttachVolumeNegativeTest-722614164 None] Lock "cinder-50b06aa4-a718-4d0e-a27e-dce5e0d673ed-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:59:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e818bb51-13f2-4f93-a7fe-55aa1652a44d tempest-AttachVolumeNegativeTest-722614164 None] Acquiring lock "cinder-quobyte-50b06aa4-a718-4d0e-a27e-dce5e0d673ed" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:59:46 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e818bb51-13f2-4f93-a7fe-55aa1652a44d tempest-AttachVolumeNegativeTest-722614164 None] Lock "cinder-quobyte-50b06aa4-a718-4d0e-a27e-dce5e0d673ed" acquired by "delete_volume" :: waited 0.039s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:59:46 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bb15badb-1d5e-4471-81fe-46545ea48f92 1073741824" returned: 0 in 1.047s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9262fc84-dee5-4b0b-b39b-3dc079c3646e tempest-AttachVolumeNegativeTest-722614164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.802s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:46 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-9262fc84-dee5-4b0b-b39b-3dc079c3646e tempest-AttachVolumeNegativeTest-722614164 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:59:46 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40c6b87-1100-47be-8d9e-75835f36c51e]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:59:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e818bb51-13f2-4f93-a7fe-55aa1652a44d tempest-AttachVolumeNegativeTest-722614164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-50b06aa4-a718-4d0e-a27e-dce5e0d673ed {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:46 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-9262fc84-dee5-4b0b-b39b-3dc079c3646e tempest-AttachVolumeNegativeTest-722614164 None] Deleted volume successfully. Nov 04 18:59:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bb15badb-1d5e-4471-81fe-46545ea48f92 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9262fc84-dee5-4b0b-b39b-3dc079c3646e tempest-AttachVolumeNegativeTest-722614164 None] Lock "cinder-4924e6b7-c30a-49a8-baad-bb0a1709fa41-delete_volume" released by "delete_volume" :: held 3.210s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:59:46 devstack sudo[101189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bb15badb-1d5e-4471-81fe-46545ea48f92 Nov 04 18:59:46 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:47 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-50b06aa4-a718-4d0e-a27e-dce5e0d673ed Nov 04 18:59:47 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:47 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bb15badb-1d5e-4471-81fe-46545ea48f92" returned: 0 in 0.308s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:59:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d4088f-bd89-4a8a-80e9-1501755db547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb15badb-1d5e-4471-81fe-46545ea48f92', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4154096-0f1f-4392-98cf-5a8f8de075a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:47 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Volume volume-bb15badb-1d5e-4471-81fe-46545ea48f92 (bb15badb-1d5e-4471-81fe-46545ea48f92): created successfully Nov 04 18:59:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4154096-0f1f-4392-98cf-5a8f8de075a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Flow 'volume_create_manager' (7ce1baa8-a89a-481d-9c69-15525e029bea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:59:47 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-f5fe8b53-b30b-4f93-bd99-f05b6c4881bb tempest-TestMinimumBasicScenario-1667222313 None] Created volume successfully. Nov 04 18:59:47 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e818bb51-13f2-4f93-a7fe-55aa1652a44d tempest-AttachVolumeNegativeTest-722614164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-50b06aa4-a718-4d0e-a27e-dce5e0d673ed" returned: 0 in 0.544s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e818bb51-13f2-4f93-a7fe-55aa1652a44d tempest-AttachVolumeNegativeTest-722614164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-50b06aa4-a718-4d0e-a27e-dce5e0d673ed {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:47 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-50b06aa4-a718-4d0e-a27e-dce5e0d673ed Nov 04 18:59:47 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:47 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e818bb51-13f2-4f93-a7fe-55aa1652a44d tempest-AttachVolumeNegativeTest-722614164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-50b06aa4-a718-4d0e-a27e-dce5e0d673ed" returned: 0 in 0.381s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:47 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e818bb51-13f2-4f93-a7fe-55aa1652a44d tempest-AttachVolumeNegativeTest-722614164 None] Lock "cinder-quobyte-50b06aa4-a718-4d0e-a27e-dce5e0d673ed" released by "delete_volume" :: held 1.000s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:59:47 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-e818bb51-13f2-4f93-a7fe-55aa1652a44d tempest-AttachVolumeNegativeTest-722614164 None] Created reservations ['2b7ed227-61b7-4246-b408-ee76c7dd8f61', '099b95f9-b94d-45f0-8a5e-d0284c4622ab', 'abddf3ea-4753-4b86-a1c2-fef376ecb63c', '2ca36050-ddb3-47a5-b9c0-bbefbc4c7a5f'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:59:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e818bb51-13f2-4f93-a7fe-55aa1652a44d tempest-AttachVolumeNegativeTest-722614164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e818bb51-13f2-4f93-a7fe-55aa1652a44d tempest-AttachVolumeNegativeTest-722614164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e818bb51-13f2-4f93-a7fe-55aa1652a44d tempest-AttachVolumeNegativeTest-722614164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:59:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e818bb51-13f2-4f93-a7fe-55aa1652a44d tempest-AttachVolumeNegativeTest-722614164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:59:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e818bb51-13f2-4f93-a7fe-55aa1652a44d tempest-AttachVolumeNegativeTest-722614164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e818bb51-13f2-4f93-a7fe-55aa1652a44d tempest-AttachVolumeNegativeTest-722614164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:48 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:59:48 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:48 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e818bb51-13f2-4f93-a7fe-55aa1652a44d tempest-AttachVolumeNegativeTest-722614164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.300s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:48 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-e818bb51-13f2-4f93-a7fe-55aa1652a44d tempest-AttachVolumeNegativeTest-722614164 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:59:48 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e818bb51-13f2-4f93-a7fe-55aa1652a44d tempest-AttachVolumeNegativeTest-722614164 None] Deleted volume successfully. Nov 04 18:59:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e818bb51-13f2-4f93-a7fe-55aa1652a44d tempest-AttachVolumeNegativeTest-722614164 None] Lock "cinder-50b06aa4-a718-4d0e-a27e-dce5e0d673ed-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:59:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-541c5c57-b08b-4093-8568-b32340506572 req-129d9b01-f8f8-42ab-b579-ddfb72373ba4 tempest-TestMinimumBasicScenario-1667222313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-541c5c57-b08b-4093-8568-b32340506572 req-129d9b01-f8f8-42ab-b579-ddfb72373ba4 tempest-TestMinimumBasicScenario-1667222313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-541c5c57-b08b-4093-8568-b32340506572 req-129d9b01-f8f8-42ab-b579-ddfb72373ba4 tempest-TestMinimumBasicScenario-1667222313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:49 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-541c5c57-b08b-4093-8568-b32340506572 req-129d9b01-f8f8-42ab-b579-ddfb72373ba4 tempest-TestMinimumBasicScenario-1667222313 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280', 'name': 'volume-bb15badb-1d5e-4471-81fe-46545ea48f92', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9fc6a6f-40f3-44e7-a18d-3a26990b51e8', 'enforce_multipath': True} {{(pid=87119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:59:49 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-541c5c57-b08b-4093-8568-b32340506572 req-129d9b01-f8f8-42ab-b579-ddfb72373ba4 tempest-TestMinimumBasicScenario-1667222313 None] attachment_update completed successfully. Nov 04 18:59:49 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f9e41cba-552e-4567-9fe3-4010a4904c21 tempest-AttachVolumeNegativeTest-722614164 None] Acquiring lock "cinder-f5580b7b-2559-436d-84d2-e97cbb8d845a-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:59:49 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f9e41cba-552e-4567-9fe3-4010a4904c21 tempest-AttachVolumeNegativeTest-722614164 None] Lock "cinder-f5580b7b-2559-436d-84d2-e97cbb8d845a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:59:49 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f9e41cba-552e-4567-9fe3-4010a4904c21 tempest-AttachVolumeNegativeTest-722614164 None] Acquiring lock "cinder-quobyte-f5580b7b-2559-436d-84d2-e97cbb8d845a" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:59:49 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f9e41cba-552e-4567-9fe3-4010a4904c21 tempest-AttachVolumeNegativeTest-722614164 None] Lock "cinder-quobyte-f5580b7b-2559-436d-84d2-e97cbb8d845a" acquired by "delete_volume" :: waited 0.021s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:59:49 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fe4a28-98df-421e-a469-18b89564cc26]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:59:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f9e41cba-552e-4567-9fe3-4010a4904c21 tempest-AttachVolumeNegativeTest-722614164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f5580b7b-2559-436d-84d2-e97cbb8d845a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:49 devstack sudo[101252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f5580b7b-2559-436d-84d2-e97cbb8d845a Nov 04 18:59:49 devstack sudo[101252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:49 devstack sudo[101252]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f9e41cba-552e-4567-9fe3-4010a4904c21 tempest-AttachVolumeNegativeTest-722614164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f5580b7b-2559-436d-84d2-e97cbb8d845a" returned: 0 in 0.494s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f9e41cba-552e-4567-9fe3-4010a4904c21 tempest-AttachVolumeNegativeTest-722614164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f5580b7b-2559-436d-84d2-e97cbb8d845a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:49 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f5580b7b-2559-436d-84d2-e97cbb8d845a Nov 04 18:59:49 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:50 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f9e41cba-552e-4567-9fe3-4010a4904c21 tempest-AttachVolumeNegativeTest-722614164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f5580b7b-2559-436d-84d2-e97cbb8d845a" returned: 0 in 0.325s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:50 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f9e41cba-552e-4567-9fe3-4010a4904c21 tempest-AttachVolumeNegativeTest-722614164 None] Lock "cinder-quobyte-f5580b7b-2559-436d-84d2-e97cbb8d845a" released by "delete_volume" :: held 0.904s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:59:50 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-f9e41cba-552e-4567-9fe3-4010a4904c21 tempest-AttachVolumeNegativeTest-722614164 None] Created reservations ['76381e51-a766-415d-8357-4dd7c9f24a8d', 'c6bd872f-023b-4b40-9d59-6eb42aa360a5', '105e0dec-df6b-416b-959e-7ed45db27b4c', '1349c8d3-bb9f-4ae6-b83a-78f668d3752b'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:59:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f9e41cba-552e-4567-9fe3-4010a4904c21 tempest-AttachVolumeNegativeTest-722614164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f9e41cba-552e-4567-9fe3-4010a4904c21 tempest-AttachVolumeNegativeTest-722614164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:50 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f9e41cba-552e-4567-9fe3-4010a4904c21 tempest-AttachVolumeNegativeTest-722614164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:59:50 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f9e41cba-552e-4567-9fe3-4010a4904c21 tempest-AttachVolumeNegativeTest-722614164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:59:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f9e41cba-552e-4567-9fe3-4010a4904c21 tempest-AttachVolumeNegativeTest-722614164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f9e41cba-552e-4567-9fe3-4010a4904c21 tempest-AttachVolumeNegativeTest-722614164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:50 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 18:59:50 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:51 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f9e41cba-552e-4567-9fe3-4010a4904c21 tempest-AttachVolumeNegativeTest-722614164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.436s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:51 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-f9e41cba-552e-4567-9fe3-4010a4904c21 tempest-AttachVolumeNegativeTest-722614164 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:59:51 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-f9e41cba-552e-4567-9fe3-4010a4904c21 tempest-AttachVolumeNegativeTest-722614164 None] Deleted volume successfully. Nov 04 18:59:51 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f9e41cba-552e-4567-9fe3-4010a4904c21 tempest-AttachVolumeNegativeTest-722614164 None] Lock "cinder-f5580b7b-2559-436d-84d2-e97cbb8d845a-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:00 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:UPDATE=31,cinder:SELECT=21,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:00:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-d5389a72-a7fa-4d1e-b183-b4d5c5072b27 req-8d82d80a-63ea-48aa-860b-2385bf94b2e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-d5389a72-a7fa-4d1e-b183-b4d5c5072b27 req-8d82d80a-63ea-48aa-860b-2385bf94b2e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:01 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=74,cinder:INSERT=20,cinder:UPDATE=69,cinder:DELETE=6 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:00:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-d5389a72-a7fa-4d1e-b183-b4d5c5072b27 req-8d82d80a-63ea-48aa-860b-2385bf94b2e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-d5389a72-a7fa-4d1e-b183-b4d5c5072b27 req-8d82d80a-63ea-48aa-860b-2385bf94b2e6 tempest-TestInstancesWithCinderVolumes-797267290 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280', 'name': 'volume-e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2ccde436-b3e1-457d-a264-97df0798f3ff', 'enforce_multipath': True} {{(pid=87119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:00:01 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-d5389a72-a7fa-4d1e-b183-b4d5c5072b27 req-8d82d80a-63ea-48aa-860b-2385bf94b2e6 tempest-TestInstancesWithCinderVolumes-797267290 None] attachment_update completed successfully. Nov 04 19:00:01 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:00:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Flow 'volume_create_manager' (cd8b0ec2-91d2-449b-afb9-7d63fea029f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (765d7787-4cf5-44ec-a9c1-3ce6d1345d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (765d7787-4cf5-44ec-a9c1-3ce6d1345d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-757888447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e8c4626-ef05-4fae-a3de-635672b1266e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aae582ee3d9340e193f61c735dde33c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:01Z,use_quota=True,user_id='9bc8091f3709420d9ac58bfe5a97c93a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6797099d-b781-4daf-9541-7a0aaf87ea57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6797099d-b781-4daf-9541-7a0aaf87ea57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13fd427-16a6-4384-b5eb-da2850378623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13fd427-16a6-4384-b5eb-da2850378623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e8c4626-ef05-4fae-a3de-635672b1266e', 'volume_name': 'volume-8e8c4626-ef05-4fae-a3de-635672b1266e', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4eb3cbc-9e2c-41a3-9a1a-795b7fea0e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4eb3cbc-9e2c-41a3-9a1a-795b7fea0e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (137853fe-822a-425c-8967-4a447eafb08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:01 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Volume 8e8c4626-ef05-4fae-a3de-635672b1266e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e8c4626-ef05-4fae-a3de-635672b1266e', 'volume_size': 1} Nov 04 19:00:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:01 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-757888447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e8c4626-ef05-4fae-a3de-635672b1266e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aae582ee3d9340e193f61c735dde33c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:01Z,use_quota=True,user_id='9bc8091f3709420d9ac58bfe5a97c93a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:00:01 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Creating volume 8e8c4626-ef05-4fae-a3de-635672b1266e {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:00:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:01 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:01 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:01 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:00:01 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:00:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8e8c4626-ef05-4fae-a3de-635672b1266e 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:01 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8e8c4626-ef05-4fae-a3de-635672b1266e 1073741824 Nov 04 19:00:01 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:02 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8e8c4626-ef05-4fae-a3de-635672b1266e 1073741824" returned: 0 in 0.693s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8e8c4626-ef05-4fae-a3de-635672b1266e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:02 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8e8c4626-ef05-4fae-a3de-635672b1266e Nov 04 19:00:02 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:02 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8e8c4626-ef05-4fae-a3de-635672b1266e" returned: 0 in 0.269s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:00:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (137853fe-822a-425c-8967-4a447eafb08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e8c4626-ef05-4fae-a3de-635672b1266e', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ab66e8-6734-40a8-915c-0ff6d29414ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:02 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Volume volume-8e8c4626-ef05-4fae-a3de-635672b1266e (8e8c4626-ef05-4fae-a3de-635672b1266e): created successfully Nov 04 19:00:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ab66e8-6734-40a8-915c-0ff6d29414ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Flow 'volume_create_manager' (cd8b0ec2-91d2-449b-afb9-7d63fea029f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:02 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-bc49cbbe-df42-4b40-b630-3a58e142caff tempest-VolumesTestJSON-310753455 None] Created volume successfully. Nov 04 19:00:04 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:00:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Flow 'volume_create_manager' (0c3bd247-e78c-48d8-9738-724762bd8211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa3cf44-be83-4625-a5b3-1ab093a6de5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa3cf44-be83-4625-a5b3-1ab093a6de5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1457482623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efcc1d88-ddc5-4142-8f12-2f4e28728c26,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aae582ee3d9340e193f61c735dde33c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:04Z,use_quota=True,user_id='9bc8091f3709420d9ac58bfe5a97c93a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029623a3-1d0a-47aa-9699-19d77d907883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029623a3-1d0a-47aa-9699-19d77d907883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ec1874-aefa-49ef-83fa-000047d2a01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ec1874-aefa-49ef-83fa-000047d2a01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efcc1d88-ddc5-4142-8f12-2f4e28728c26', 'volume_name': 'volume-efcc1d88-ddc5-4142-8f12-2f4e28728c26', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba0428a-8700-4774-a3d4-69bcff36e116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba0428a-8700-4774-a3d4-69bcff36e116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e345dd-3c07-443d-b440-62848daab97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:04 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Volume efcc1d88-ddc5-4142-8f12-2f4e28728c26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efcc1d88-ddc5-4142-8f12-2f4e28728c26', 'volume_size': 1} Nov 04 19:00:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:04 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1457482623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efcc1d88-ddc5-4142-8f12-2f4e28728c26,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aae582ee3d9340e193f61c735dde33c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:04Z,use_quota=True,user_id='9bc8091f3709420d9ac58bfe5a97c93a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:00:04 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Creating volume efcc1d88-ddc5-4142-8f12-2f4e28728c26 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:00:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:04 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:04 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:04 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:00:04 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:00:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-efcc1d88-ddc5-4142-8f12-2f4e28728c26 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-fbd852a4-2af6-4a16-9f2d-d309933ee6ca req-971e318f-8a6e-4133-8066-6712c1d51c10 tempest-TestInstancesWithCinderVolumes-797267290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:04 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-efcc1d88-ddc5-4142-8f12-2f4e28728c26 1073741824 Nov 04 19:00:04 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:05 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-efcc1d88-ddc5-4142-8f12-2f4e28728c26 1073741824" returned: 0 in 0.629s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-efcc1d88-ddc5-4142-8f12-2f4e28728c26 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:05 devstack sudo[101354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-efcc1d88-ddc5-4142-8f12-2f4e28728c26 Nov 04 19:00:05 devstack sudo[101354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:05 devstack sudo[101354]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-efcc1d88-ddc5-4142-8f12-2f4e28728c26" returned: 0 in 0.262s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:00:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-fbd852a4-2af6-4a16-9f2d-d309933ee6ca req-971e318f-8a6e-4133-8066-6712c1d51c10 tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e345dd-3c07-443d-b440-62848daab97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efcc1d88-ddc5-4142-8f12-2f4e28728c26', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (488f12f3-7215-4e6b-976f-da07b7979add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-fbd852a4-2af6-4a16-9f2d-d309933ee6ca req-971e318f-8a6e-4133-8066-6712c1d51c10 tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:05 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Volume volume-efcc1d88-ddc5-4142-8f12-2f4e28728c26 (efcc1d88-ddc5-4142-8f12-2f4e28728c26): created successfully Nov 04 19:00:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (488f12f3-7215-4e6b-976f-da07b7979add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Flow 'volume_create_manager' (0c3bd247-e78c-48d8-9738-724762bd8211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:05 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-da4694e3-5bd1-482b-8b57-ad2d9f8ff4d8 tempest-VolumesTestJSON-310753455 None] Created volume successfully. Nov 04 19:00:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-fbd852a4-2af6-4a16-9f2d-d309933ee6ca req-971e318f-8a6e-4133-8066-6712c1d51c10 tempest-TestInstancesWithCinderVolumes-797267290 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280', 'name': 'volume-27800128-6406-44a9-915c-3ba3b714b4f4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca7099a4-4387-475a-b610-29af6059e793', 'enforce_multipath': True} {{(pid=87119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:00:05 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-fbd852a4-2af6-4a16-9f2d-d309933ee6ca req-971e318f-8a6e-4133-8066-6712c1d51c10 tempest-TestInstancesWithCinderVolumes-797267290 None] attachment_update completed successfully. Nov 04 19:00:07 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:00:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Flow 'volume_create_manager' (e7c3810b-c7f5-4da6-9d29-46c20b891803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5701372-45d4-4c7a-bf11-0c7c428f1cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5701372-45d4-4c7a-bf11-0c7c428f1cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-453859575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88c91f40-1c5e-4373-877d-3d5f356e5b37,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aae582ee3d9340e193f61c735dde33c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:07Z,use_quota=True,user_id='9bc8091f3709420d9ac58bfe5a97c93a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a230183b-343b-4858-9ebb-614c1df3418c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a230183b-343b-4858-9ebb-614c1df3418c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c9799a0-75cd-43d0-8f8a-cf2813d82e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c9799a0-75cd-43d0-8f8a-cf2813d82e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88c91f40-1c5e-4373-877d-3d5f356e5b37', 'volume_name': 'volume-88c91f40-1c5e-4373-877d-3d5f356e5b37', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355ec7d4-62b3-4240-b410-118ce7df873d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355ec7d4-62b3-4240-b410-118ce7df873d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (889f9cfb-2032-4bde-ae21-fff607910e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:07 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Volume 88c91f40-1c5e-4373-877d-3d5f356e5b37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88c91f40-1c5e-4373-877d-3d5f356e5b37', 'volume_size': 1} Nov 04 19:00:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-453859575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88c91f40-1c5e-4373-877d-3d5f356e5b37,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aae582ee3d9340e193f61c735dde33c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:07Z,use_quota=True,user_id='9bc8091f3709420d9ac58bfe5a97c93a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:00:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Creating volume 88c91f40-1c5e-4373-877d-3d5f356e5b37 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:00:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:00:07 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:00:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-88c91f40-1c5e-4373-877d-3d5f356e5b37 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:07 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-88c91f40-1c5e-4373-877d-3d5f356e5b37 1073741824 Nov 04 19:00:07 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:07 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-88c91f40-1c5e-4373-877d-3d5f356e5b37 1073741824" returned: 0 in 0.616s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-88c91f40-1c5e-4373-877d-3d5f356e5b37 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:07 devstack sudo[101375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-88c91f40-1c5e-4373-877d-3d5f356e5b37 Nov 04 19:00:07 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:08 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-88c91f40-1c5e-4373-877d-3d5f356e5b37" returned: 0 in 0.318s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:00:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (889f9cfb-2032-4bde-ae21-fff607910e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88c91f40-1c5e-4373-877d-3d5f356e5b37', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32417696-7043-4b70-b144-816cff5a90f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:08 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Volume volume-88c91f40-1c5e-4373-877d-3d5f356e5b37 (88c91f40-1c5e-4373-877d-3d5f356e5b37): created successfully Nov 04 19:00:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32417696-7043-4b70-b144-816cff5a90f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Flow 'volume_create_manager' (e7c3810b-c7f5-4da6-9d29-46c20b891803) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:08 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-54e222a8-7da3-4549-a271-98c99c9ad3c4 tempest-VolumesTestJSON-310753455 None] Created volume successfully. Nov 04 19:00:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d7072d82-32b1-4b73-bfc1-550ab2bfd7d1 tempest-VolumesTestJSON-310753455 None] Acquiring lock "cinder-88c91f40-1c5e-4373-877d-3d5f356e5b37-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d7072d82-32b1-4b73-bfc1-550ab2bfd7d1 tempest-VolumesTestJSON-310753455 None] Lock "cinder-88c91f40-1c5e-4373-877d-3d5f356e5b37-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d7072d82-32b1-4b73-bfc1-550ab2bfd7d1 tempest-VolumesTestJSON-310753455 None] Acquiring lock "cinder-quobyte-88c91f40-1c5e-4373-877d-3d5f356e5b37" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d7072d82-32b1-4b73-bfc1-550ab2bfd7d1 tempest-VolumesTestJSON-310753455 None] Lock "cinder-quobyte-88c91f40-1c5e-4373-877d-3d5f356e5b37" acquired by "delete_volume" :: waited 0.018s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:10 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fb5562-675c-41bd-8cc8-022fab98c8c9]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d7072d82-32b1-4b73-bfc1-550ab2bfd7d1 tempest-VolumesTestJSON-310753455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-88c91f40-1c5e-4373-877d-3d5f356e5b37 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:10 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-88c91f40-1c5e-4373-877d-3d5f356e5b37 Nov 04 19:00:10 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:10 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d7072d82-32b1-4b73-bfc1-550ab2bfd7d1 tempest-VolumesTestJSON-310753455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-88c91f40-1c5e-4373-877d-3d5f356e5b37" returned: 0 in 0.584s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d7072d82-32b1-4b73-bfc1-550ab2bfd7d1 tempest-VolumesTestJSON-310753455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-88c91f40-1c5e-4373-877d-3d5f356e5b37 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:10 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-88c91f40-1c5e-4373-877d-3d5f356e5b37 Nov 04 19:00:10 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:11 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-7178fd55-4c9b-4048-9eed-45f167c326aa req-86cba7af-42d2-427f-af9a-0639837dc985 tempest-TestInstancesWithCinderVolumes-797267290 None] Terminate volume connection completed successfully. Nov 04 19:00:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-7178fd55-4c9b-4048-9eed-45f167c326aa req-86cba7af-42d2-427f-af9a-0639837dc985 tempest-TestInstancesWithCinderVolumes-797267290 None] Deleting attachment 2ccde436-b3e1-457d-a264-97df0798f3ff. {{(pid=87119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:00:11 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d7072d82-32b1-4b73-bfc1-550ab2bfd7d1 tempest-VolumesTestJSON-310753455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-88c91f40-1c5e-4373-877d-3d5f356e5b37" returned: 0 in 0.316s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:11 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d7072d82-32b1-4b73-bfc1-550ab2bfd7d1 tempest-VolumesTestJSON-310753455 None] Lock "cinder-quobyte-88c91f40-1c5e-4373-877d-3d5f356e5b37" released by "delete_volume" :: held 0.980s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:11 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-d7072d82-32b1-4b73-bfc1-550ab2bfd7d1 tempest-VolumesTestJSON-310753455 None] Created reservations ['354c23cc-4bae-41de-88ff-fb17b814ab1e', '962678ee-2d16-44c4-b487-9664d18b8de3', '8c94bf0f-2128-419a-adf7-534118459652', 'e145289a-3a6d-4035-a03e-c0932a8e9288'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:00:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d7072d82-32b1-4b73-bfc1-550ab2bfd7d1 tempest-VolumesTestJSON-310753455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d7072d82-32b1-4b73-bfc1-550ab2bfd7d1 tempest-VolumesTestJSON-310753455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:11 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d7072d82-32b1-4b73-bfc1-550ab2bfd7d1 tempest-VolumesTestJSON-310753455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:11 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d7072d82-32b1-4b73-bfc1-550ab2bfd7d1 tempest-VolumesTestJSON-310753455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d7072d82-32b1-4b73-bfc1-550ab2bfd7d1 tempest-VolumesTestJSON-310753455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d7072d82-32b1-4b73-bfc1-550ab2bfd7d1 tempest-VolumesTestJSON-310753455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:11 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:00:11 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:11 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1a5f121b-3941-4572-829c-ac184633c3bc tempest-TestInstancesWithCinderVolumes-797267290 None] Acquiring lock "cinder-e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:12 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1a5f121b-3941-4572-829c-ac184633c3bc tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "cinder-e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d7072d82-32b1-4b73-bfc1-550ab2bfd7d1 tempest-VolumesTestJSON-310753455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.525s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:12 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-d7072d82-32b1-4b73-bfc1-550ab2bfd7d1 tempest-VolumesTestJSON-310753455 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:00:12 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-d7072d82-32b1-4b73-bfc1-550ab2bfd7d1 tempest-VolumesTestJSON-310753455 None] Deleted volume successfully. Nov 04 19:00:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d7072d82-32b1-4b73-bfc1-550ab2bfd7d1 tempest-VolumesTestJSON-310753455 None] Lock "cinder-88c91f40-1c5e-4373-877d-3d5f356e5b37-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1a5f121b-3941-4572-829c-ac184633c3bc tempest-TestInstancesWithCinderVolumes-797267290 None] Acquiring lock "cinder-quobyte-e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1a5f121b-3941-4572-829c-ac184633c3bc tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "cinder-quobyte-e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f" acquired by "delete_volume" :: waited 0.027s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:12 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe168eeb-3799-4d01-88bc-7ee219db73a5]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a5f121b-3941-4572-829c-ac184633c3bc tempest-TestInstancesWithCinderVolumes-797267290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:12 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f Nov 04 19:00:12 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f7ee390d-03d4-47bf-a4b6-799cab3d97f4 tempest-VolumesTestJSON-310753455 None] Acquiring lock "cinder-efcc1d88-ddc5-4142-8f12-2f4e28728c26-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f7ee390d-03d4-47bf-a4b6-799cab3d97f4 tempest-VolumesTestJSON-310753455 None] Lock "cinder-efcc1d88-ddc5-4142-8f12-2f4e28728c26-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f7ee390d-03d4-47bf-a4b6-799cab3d97f4 tempest-VolumesTestJSON-310753455 None] Acquiring lock "cinder-quobyte-efcc1d88-ddc5-4142-8f12-2f4e28728c26" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f7ee390d-03d4-47bf-a4b6-799cab3d97f4 tempest-VolumesTestJSON-310753455 None] Lock "cinder-quobyte-efcc1d88-ddc5-4142-8f12-2f4e28728c26" acquired by "delete_volume" :: waited 0.031s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:12 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[7373f97f-cf27-48a4-baf9-2b0c1f28e9ac]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f7ee390d-03d4-47bf-a4b6-799cab3d97f4 tempest-VolumesTestJSON-310753455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-efcc1d88-ddc5-4142-8f12-2f4e28728c26 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:12 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a5f121b-3941-4572-829c-ac184633c3bc tempest-TestInstancesWithCinderVolumes-797267290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f" returned: 0 in 0.657s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a5f121b-3941-4572-829c-ac184633c3bc tempest-TestInstancesWithCinderVolumes-797267290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:12 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f Nov 04 19:00:12 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:12 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-efcc1d88-ddc5-4142-8f12-2f4e28728c26 Nov 04 19:00:12 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:13 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a5f121b-3941-4572-829c-ac184633c3bc tempest-TestInstancesWithCinderVolumes-797267290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f" returned: 0 in 0.370s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:13 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1a5f121b-3941-4572-829c-ac184633c3bc tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "cinder-quobyte-e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f" released by "delete_volume" :: held 1.115s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:13 devstack cinder-volume[87119]: WARNING cinder.quota [None req-1a5f121b-3941-4572-829c-ac184633c3bc tempest-TestInstancesWithCinderVolumes-797267290 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1230877333-1490897188 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1230877333-1490897188, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:00:13 devstack cinder-volume[87119]: WARNING cinder.quota [None req-1a5f121b-3941-4572-829c-ac184633c3bc tempest-TestInstancesWithCinderVolumes-797267290 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1230877333-1490897188 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1230877333-1490897188, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:00:13 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f7ee390d-03d4-47bf-a4b6-799cab3d97f4 tempest-VolumesTestJSON-310753455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-efcc1d88-ddc5-4142-8f12-2f4e28728c26" returned: 0 in 0.621s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f7ee390d-03d4-47bf-a4b6-799cab3d97f4 tempest-VolumesTestJSON-310753455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-efcc1d88-ddc5-4142-8f12-2f4e28728c26 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:13 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-1a5f121b-3941-4572-829c-ac184633c3bc tempest-TestInstancesWithCinderVolumes-797267290 None] Created reservations ['56cef37f-d7a9-4477-849d-5d4de8c9a700', 'f5b7e3eb-8cef-4053-b18d-1815fa43af09', '7cddc721-be3c-45ff-803a-3a03280b796e', '8a72cd4f-1d0a-45d7-ac38-5ba2fe1c28a8'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:00:13 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-efcc1d88-ddc5-4142-8f12-2f4e28728c26 Nov 04 19:00:13 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1a5f121b-3941-4572-829c-ac184633c3bc tempest-TestInstancesWithCinderVolumes-797267290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1a5f121b-3941-4572-829c-ac184633c3bc tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:13 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1a5f121b-3941-4572-829c-ac184633c3bc tempest-TestInstancesWithCinderVolumes-797267290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:13 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1a5f121b-3941-4572-829c-ac184633c3bc tempest-TestInstancesWithCinderVolumes-797267290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1a5f121b-3941-4572-829c-ac184633c3bc tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a5f121b-3941-4572-829c-ac184633c3bc tempest-TestInstancesWithCinderVolumes-797267290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:13 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:00:13 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:13 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f7ee390d-03d4-47bf-a4b6-799cab3d97f4 tempest-VolumesTestJSON-310753455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-efcc1d88-ddc5-4142-8f12-2f4e28728c26" returned: 0 in 0.364s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:13 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f7ee390d-03d4-47bf-a4b6-799cab3d97f4 tempest-VolumesTestJSON-310753455 None] Lock "cinder-quobyte-efcc1d88-ddc5-4142-8f12-2f4e28728c26" released by "delete_volume" :: held 1.067s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:13 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-f7ee390d-03d4-47bf-a4b6-799cab3d97f4 tempest-VolumesTestJSON-310753455 None] Created reservations ['6b5af44f-0982-48b3-bf40-865ff2eac385', '8f67b94f-8ccb-491e-b526-d909b1c88e75', '5f367344-6f15-4ed8-aeec-e5768ac4a2d2', 'a9e6bfed-7078-4005-bbf6-d3bb7ed149a6'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:00:14 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a5f121b-3941-4572-829c-ac184633c3bc tempest-TestInstancesWithCinderVolumes-797267290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.444s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:14 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-1a5f121b-3941-4572-829c-ac184633c3bc tempest-TestInstancesWithCinderVolumes-797267290 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:00:14 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-1a5f121b-3941-4572-829c-ac184633c3bc tempest-TestInstancesWithCinderVolumes-797267290 None] Deleted volume successfully. Nov 04 19:00:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f7ee390d-03d4-47bf-a4b6-799cab3d97f4 tempest-VolumesTestJSON-310753455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f7ee390d-03d4-47bf-a4b6-799cab3d97f4 tempest-VolumesTestJSON-310753455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f7ee390d-03d4-47bf-a4b6-799cab3d97f4 tempest-VolumesTestJSON-310753455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f7ee390d-03d4-47bf-a4b6-799cab3d97f4 tempest-VolumesTestJSON-310753455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f7ee390d-03d4-47bf-a4b6-799cab3d97f4 tempest-VolumesTestJSON-310753455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f7ee390d-03d4-47bf-a4b6-799cab3d97f4 tempest-VolumesTestJSON-310753455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1a5f121b-3941-4572-829c-ac184633c3bc tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "cinder-e452e85c-7f2c-42c0-9030-aa1bbe6cbf6f-delete_volume" released by "delete_volume" :: held 2.114s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:14 devstack sudo[101447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:00:14 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:14 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f7ee390d-03d4-47bf-a4b6-799cab3d97f4 tempest-VolumesTestJSON-310753455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.322s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:14 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-f7ee390d-03d4-47bf-a4b6-799cab3d97f4 tempest-VolumesTestJSON-310753455 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:00:14 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-f7ee390d-03d4-47bf-a4b6-799cab3d97f4 tempest-VolumesTestJSON-310753455 None] Deleted volume successfully. Nov 04 19:00:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f7ee390d-03d4-47bf-a4b6-799cab3d97f4 tempest-VolumesTestJSON-310753455 None] Lock "cinder-efcc1d88-ddc5-4142-8f12-2f4e28728c26-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d37a0ffd-6d28-41fe-b5c2-287a571ea0e1 tempest-VolumesTestJSON-310753455 None] Acquiring lock "cinder-8e8c4626-ef05-4fae-a3de-635672b1266e-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:15 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d37a0ffd-6d28-41fe-b5c2-287a571ea0e1 tempest-VolumesTestJSON-310753455 None] Lock "cinder-8e8c4626-ef05-4fae-a3de-635672b1266e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:15 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d37a0ffd-6d28-41fe-b5c2-287a571ea0e1 tempest-VolumesTestJSON-310753455 None] Acquiring lock "cinder-quobyte-8e8c4626-ef05-4fae-a3de-635672b1266e" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:15 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d37a0ffd-6d28-41fe-b5c2-287a571ea0e1 tempest-VolumesTestJSON-310753455 None] Lock "cinder-quobyte-8e8c4626-ef05-4fae-a3de-635672b1266e" acquired by "delete_volume" :: waited 0.032s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:15 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[9523cff6-1c30-4862-a1d6-7efca42be315]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d37a0ffd-6d28-41fe-b5c2-287a571ea0e1 tempest-VolumesTestJSON-310753455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8e8c4626-ef05-4fae-a3de-635672b1266e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:15 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8e8c4626-ef05-4fae-a3de-635672b1266e Nov 04 19:00:15 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:15 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d37a0ffd-6d28-41fe-b5c2-287a571ea0e1 tempest-VolumesTestJSON-310753455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8e8c4626-ef05-4fae-a3de-635672b1266e" returned: 0 in 0.463s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d37a0ffd-6d28-41fe-b5c2-287a571ea0e1 tempest-VolumesTestJSON-310753455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8e8c4626-ef05-4fae-a3de-635672b1266e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:15 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8e8c4626-ef05-4fae-a3de-635672b1266e Nov 04 19:00:15 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:15 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d37a0ffd-6d28-41fe-b5c2-287a571ea0e1 tempest-VolumesTestJSON-310753455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8e8c4626-ef05-4fae-a3de-635672b1266e" returned: 0 in 0.319s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:15 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d37a0ffd-6d28-41fe-b5c2-287a571ea0e1 tempest-VolumesTestJSON-310753455 None] Lock "cinder-quobyte-8e8c4626-ef05-4fae-a3de-635672b1266e" released by "delete_volume" :: held 0.859s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:16 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-d37a0ffd-6d28-41fe-b5c2-287a571ea0e1 tempest-VolumesTestJSON-310753455 None] Created reservations ['e1728ff6-3e31-4e9f-a256-82dab62e4aca', '99af7b51-5b16-4694-8f4c-fc42ff848257', 'b9cec7bd-0478-41f0-b530-1f85c58c9c23', '7f1494bc-95c2-4cba-9281-4b0b7674c426'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:00:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d37a0ffd-6d28-41fe-b5c2-287a571ea0e1 tempest-VolumesTestJSON-310753455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d37a0ffd-6d28-41fe-b5c2-287a571ea0e1 tempest-VolumesTestJSON-310753455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:16 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d37a0ffd-6d28-41fe-b5c2-287a571ea0e1 tempest-VolumesTestJSON-310753455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:16 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d37a0ffd-6d28-41fe-b5c2-287a571ea0e1 tempest-VolumesTestJSON-310753455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d37a0ffd-6d28-41fe-b5c2-287a571ea0e1 tempest-VolumesTestJSON-310753455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d37a0ffd-6d28-41fe-b5c2-287a571ea0e1 tempest-VolumesTestJSON-310753455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:16 devstack sudo[101505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:00:16 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:16 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d37a0ffd-6d28-41fe-b5c2-287a571ea0e1 tempest-VolumesTestJSON-310753455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.543s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:16 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-d37a0ffd-6d28-41fe-b5c2-287a571ea0e1 tempest-VolumesTestJSON-310753455 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:00:16 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-d37a0ffd-6d28-41fe-b5c2-287a571ea0e1 tempest-VolumesTestJSON-310753455 None] Deleted volume successfully. Nov 04 19:00:16 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d37a0ffd-6d28-41fe-b5c2-287a571ea0e1 tempest-VolumesTestJSON-310753455 None] Lock "cinder-8e8c4626-ef05-4fae-a3de-635672b1266e-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:17 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-a145fcc4-a889-4356-a63c-041fbc4fcd74 req-a1c2904c-b93d-47ce-981a-dafca99c86e1 tempest-TestInstancesWithCinderVolumes-797267290 None] Terminate volume connection completed successfully. Nov 04 19:00:17 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-a145fcc4-a889-4356-a63c-041fbc4fcd74 req-a1c2904c-b93d-47ce-981a-dafca99c86e1 tempest-TestInstancesWithCinderVolumes-797267290 None] Deleting attachment ca7099a4-4387-475a-b610-29af6059e793. {{(pid=87119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:00:17 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-939e70da-5df4-487b-9c92-4a440c2b276d tempest-TestInstancesWithCinderVolumes-797267290 None] Acquiring lock "cinder-27800128-6406-44a9-915c-3ba3b714b4f4-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:17 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-939e70da-5df4-487b-9c92-4a440c2b276d tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "cinder-27800128-6406-44a9-915c-3ba3b714b4f4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:17 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-939e70da-5df4-487b-9c92-4a440c2b276d tempest-TestInstancesWithCinderVolumes-797267290 None] Acquiring lock "cinder-quobyte-27800128-6406-44a9-915c-3ba3b714b4f4" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:17 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-939e70da-5df4-487b-9c92-4a440c2b276d tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "cinder-quobyte-27800128-6406-44a9-915c-3ba3b714b4f4" acquired by "delete_volume" :: waited 0.034s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:17 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4265c76-caf1-46d1-9115-9fd287923555]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-939e70da-5df4-487b-9c92-4a440c2b276d tempest-TestInstancesWithCinderVolumes-797267290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-27800128-6406-44a9-915c-3ba3b714b4f4 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:18 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-27800128-6406-44a9-915c-3ba3b714b4f4 Nov 04 19:00:18 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:18 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-939e70da-5df4-487b-9c92-4a440c2b276d tempest-TestInstancesWithCinderVolumes-797267290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-27800128-6406-44a9-915c-3ba3b714b4f4" returned: 0 in 0.624s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-939e70da-5df4-487b-9c92-4a440c2b276d tempest-TestInstancesWithCinderVolumes-797267290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-27800128-6406-44a9-915c-3ba3b714b4f4 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:18 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-27800128-6406-44a9-915c-3ba3b714b4f4 Nov 04 19:00:18 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:18 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-939e70da-5df4-487b-9c92-4a440c2b276d tempest-TestInstancesWithCinderVolumes-797267290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-27800128-6406-44a9-915c-3ba3b714b4f4" returned: 0 in 0.327s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:18 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-939e70da-5df4-487b-9c92-4a440c2b276d tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "cinder-quobyte-27800128-6406-44a9-915c-3ba3b714b4f4" released by "delete_volume" :: held 1.035s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:18 devstack cinder-volume[87119]: WARNING cinder.quota [None req-939e70da-5df4-487b-9c92-4a440c2b276d tempest-TestInstancesWithCinderVolumes-797267290 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1261063773-1588530386 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1261063773-1588530386, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:00:18 devstack cinder-volume[87119]: WARNING cinder.quota [None req-939e70da-5df4-487b-9c92-4a440c2b276d tempest-TestInstancesWithCinderVolumes-797267290 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1261063773-1588530386 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1261063773-1588530386, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:00:19 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-939e70da-5df4-487b-9c92-4a440c2b276d tempest-TestInstancesWithCinderVolumes-797267290 None] Created reservations ['1deaaa91-a155-46e3-aebb-48e0da00089f', '8b8a6a60-00e8-4323-81cc-f7afaa471856', '2c32cd8f-1364-4a32-bff1-71d109085d72', '5a416f18-b106-47d7-8794-0beb6e57584b'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:00:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-939e70da-5df4-487b-9c92-4a440c2b276d tempest-TestInstancesWithCinderVolumes-797267290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-939e70da-5df4-487b-9c92-4a440c2b276d tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:19 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-939e70da-5df4-487b-9c92-4a440c2b276d tempest-TestInstancesWithCinderVolumes-797267290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:19 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-939e70da-5df4-487b-9c92-4a440c2b276d tempest-TestInstancesWithCinderVolumes-797267290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-939e70da-5df4-487b-9c92-4a440c2b276d tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-939e70da-5df4-487b-9c92-4a440c2b276d tempest-TestInstancesWithCinderVolumes-797267290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:19 devstack sudo[101521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:00:19 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:19 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-939e70da-5df4-487b-9c92-4a440c2b276d tempest-TestInstancesWithCinderVolumes-797267290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.492s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:19 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-939e70da-5df4-487b-9c92-4a440c2b276d tempest-TestInstancesWithCinderVolumes-797267290 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:00:19 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-939e70da-5df4-487b-9c92-4a440c2b276d tempest-TestInstancesWithCinderVolumes-797267290 None] Deleted volume successfully. Nov 04 19:00:19 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-939e70da-5df4-487b-9c92-4a440c2b276d tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "cinder-27800128-6406-44a9-915c-3ba3b714b4f4-delete_volume" released by "delete_volume" :: held 1.973s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:23 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-7472b11d-635d-4437-87a7-48708bb1ce40 tempest-GroupSnapshotsV319Test-462668689 None] Group tempest-GroupSnapshotsV319Test-Group-269771953: creating Nov 04 19:00:24 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-7472b11d-635d-4437-87a7-48708bb1ce40 tempest-GroupSnapshotsV319Test-462668689 None] Group tempest-GroupSnapshotsV319Test-Group-269771953: created successfully Nov 04 19:00:24 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-7472b11d-635d-4437-87a7-48708bb1ce40 tempest-GroupSnapshotsV319Test-462668689 None] Create group completed successfully. Nov 04 19:00:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:00:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:25 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:00:25 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:25 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.468s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:25 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:00:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager._thread_info {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:00:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread count: 28 {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:00:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread info: [<_MainThread(MainThread, started 130247852032128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:00:26 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:00:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Flow 'volume_create_manager' (db2b5a06-777d-45f5-839f-4ce4f9eb5a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d954ee70-9c1f-46b6-96e0-974784805e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d954ee70-9c1f-46b6-96e0-974784805e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2069462623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=212620af-86c0-4070-a4c4-eb85034dd082,host='devstack@QuobyteHD#QuobyteHD',id=851e118b-976d-4199-8448-d6246c2ef655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a1e32724954cb7ac350e3bc083116d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:26Z,use_quota=True,user_id='f9968ebf079a45c4b0bf10ff67dee30a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40a41b56-424a-4446-9bce-baf05440be54),volume_type_id=40a41b56-424a-4446-9bce-baf05440be54)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62b9f68a-bb54-4566-8eb2-83f2c5cf3d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62b9f68a-bb54-4566-8eb2-83f2c5cf3d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8dfc69-da7e-4140-a0dc-cb84783d89b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8dfc69-da7e-4140-a0dc-cb84783d89b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '851e118b-976d-4199-8448-d6246c2ef655', 'volume_name': 'volume-851e118b-976d-4199-8448-d6246c2ef655', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e196d5c5-bf8d-4ce3-abc1-cd9fe83a6a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e196d5c5-bf8d-4ce3-abc1-cd9fe83a6a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb0e4d63-7055-4803-9bd5-059c7ac8217c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:26 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Volume 851e118b-976d-4199-8448-d6246c2ef655: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-851e118b-976d-4199-8448-d6246c2ef655', 'volume_size': 1} Nov 04 19:00:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=212620af-86c0-4070-a4c4-eb85034dd082,created_at=2026-11-04T18:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2069462623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=212620af-86c0-4070-a4c4-eb85034dd082,host='devstack@QuobyteHD#QuobyteHD',id=851e118b-976d-4199-8448-d6246c2ef655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a1e32724954cb7ac350e3bc083116d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:26Z,use_quota=True,user_id='f9968ebf079a45c4b0bf10ff67dee30a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40a41b56-424a-4446-9bce-baf05440be54),volume_type_id=40a41b56-424a-4446-9bce-baf05440be54)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:00:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Creating volume 851e118b-976d-4199-8448-d6246c2ef655 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:00:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:00:26 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:00:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:26 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655 1073741824 Nov 04 19:00:26 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:27 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655 1073741824" returned: 0 in 0.876s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:27 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655 Nov 04 19:00:27 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:28 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655" returned: 0 in 0.674s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:00:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb0e4d63-7055-4803-9bd5-059c7ac8217c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-851e118b-976d-4199-8448-d6246c2ef655', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b6028e-2014-4853-9985-f0df55209bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:28 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Volume volume-851e118b-976d-4199-8448-d6246c2ef655 (851e118b-976d-4199-8448-d6246c2ef655): created successfully Nov 04 19:00:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b6028e-2014-4853-9985-f0df55209bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Flow 'volume_create_manager' (db2b5a06-777d-45f5-839f-4ce4f9eb5a59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:28 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-8ee5687c-21c6-4442-ab6d-2097e019375c tempest-GroupSnapshotsV319Test-462668689 None] Created volume successfully. Nov 04 19:00:29 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-115d8afc-9ce4-447d-bf09-93221063e884 req-54e2e1e1-69d8-48c3-a79a-54fa8bbed5ee tempest-TestInstancesWithCinderVolumes-797267290 None] Terminate volume connection completed successfully. Nov 04 19:00:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-115d8afc-9ce4-447d-bf09-93221063e884 req-54e2e1e1-69d8-48c3-a79a-54fa8bbed5ee tempest-TestInstancesWithCinderVolumes-797267290 None] Deleting attachment b754a622-538b-4935-a6ec-6bd58b6dcd60. {{(pid=87119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:00:29 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-89492a89-d41c-455b-a0c1-e42d511bb238 tempest-GroupSnapshotsV319Test-462668689 None] GroupSnapshot 73cdd45f-7c77-443c-a2a7-7f577eee90c7: creating. Nov 04 19:00:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-89492a89-d41c-455b-a0c1-e42d511bb238 tempest-GroupSnapshotsV319Test-462668689 None] Group snapshot 73cdd45f-7c77-443c-a2a7-7f577eee90c7: creating. {{(pid=87119) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 04 19:00:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-89492a89-d41c-455b-a0c1-e42d511bb238 tempest-GroupSnapshotsV319Test-462668689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-89492a89-d41c-455b-a0c1-e42d511bb238 tempest-GroupSnapshotsV319Test-462668689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-89492a89-d41c-455b-a0c1-e42d511bb238 tempest-GroupSnapshotsV319Test-462668689 None] Creating offline snapshot 96816fd7-211f-478c-bd28-b5a6068691a5 of volume 851e118b-976d-4199-8448-d6246c2ef655 {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:00:29 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ee0206-a587-4ea5-bd59-f9d361faf5d4]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-89492a89-d41c-455b-a0c1-e42d511bb238 tempest-GroupSnapshotsV319Test-462668689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:29 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655 Nov 04 19:00:29 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:30 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-89492a89-d41c-455b-a0c1-e42d511bb238 tempest-GroupSnapshotsV319Test-462668689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655" returned: 0 in 0.656s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-89492a89-d41c-455b-a0c1-e42d511bb238 tempest-GroupSnapshotsV319Test-462668689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655.96816fd7-211f-478c-bd28-b5a6068691a5 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:30 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655.96816fd7-211f-478c-bd28-b5a6068691a5 1G Nov 04 19:00:30 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ff387a38-23ee-4d7e-b77d-550ba30e8d67 tempest-TestInstancesWithCinderVolumes-797267290 None] Acquiring lock "cinder-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ff387a38-23ee-4d7e-b77d-550ba30e8d67 tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "cinder-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ff387a38-23ee-4d7e-b77d-550ba30e8d67 tempest-TestInstancesWithCinderVolumes-797267290 None] Acquiring lock "cinder-quobyte-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ff387a38-23ee-4d7e-b77d-550ba30e8d67 tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "cinder-quobyte-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9" acquired by "delete_volume" :: waited 0.018s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:30 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[a837ca56-4beb-4d7d-9678-4df4a09dcdea]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ff387a38-23ee-4d7e-b77d-550ba30e8d67 tempest-TestInstancesWithCinderVolumes-797267290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:30 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-89492a89-d41c-455b-a0c1-e42d511bb238 tempest-GroupSnapshotsV319Test-462668689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655.96816fd7-211f-478c-bd28-b5a6068691a5 1G" returned: 0 in 0.505s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-89492a89-d41c-455b-a0c1-e42d511bb238 tempest-GroupSnapshotsV319Test-462668689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-851e118b-976d-4199-8448-d6246c2ef655 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655.96816fd7-211f-478c-bd28-b5a6068691a5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:30 devstack sudo[101580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-851e118b-976d-4199-8448-d6246c2ef655 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655.96816fd7-211f-478c-bd28-b5a6068691a5 Nov 04 19:00:30 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:30 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9 Nov 04 19:00:30 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:31 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-89492a89-d41c-455b-a0c1-e42d511bb238 tempest-GroupSnapshotsV319Test-462668689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-851e118b-976d-4199-8448-d6246c2ef655 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655.96816fd7-211f-478c-bd28-b5a6068691a5" returned: 0 in 0.321s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:31 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-89492a89-d41c-455b-a0c1-e42d511bb238 tempest-GroupSnapshotsV319Test-462668689 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655.96816fd7-211f-478c-bd28-b5a6068691a5 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 19:00:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-89492a89-d41c-455b-a0c1-e42d511bb238 tempest-GroupSnapshotsV319Test-462668689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655.96816fd7-211f-478c-bd28-b5a6068691a5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:31 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655.96816fd7-211f-478c-bd28-b5a6068691a5 Nov 04 19:00:31 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:31 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ff387a38-23ee-4d7e-b77d-550ba30e8d67 tempest-TestInstancesWithCinderVolumes-797267290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9" returned: 0 in 0.459s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ff387a38-23ee-4d7e-b77d-550ba30e8d67 tempest-TestInstancesWithCinderVolumes-797267290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:31 devstack sudo[101591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9 Nov 04 19:00:31 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:31 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-89492a89-d41c-455b-a0c1-e42d511bb238 tempest-GroupSnapshotsV319Test-462668689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655.96816fd7-211f-478c-bd28-b5a6068691a5" returned: 0 in 0.277s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-89492a89-d41c-455b-a0c1-e42d511bb238 tempest-GroupSnapshotsV319Test-462668689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:31 devstack sudo[101595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655.info Nov 04 19:00:31 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:31 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ff387a38-23ee-4d7e-b77d-550ba30e8d67 tempest-TestInstancesWithCinderVolumes-797267290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9" returned: 0 in 0.289s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:31 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ff387a38-23ee-4d7e-b77d-550ba30e8d67 tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "cinder-quobyte-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9" released by "delete_volume" :: held 0.804s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:31 devstack cinder-volume[87119]: WARNING cinder.quota [None req-ff387a38-23ee-4d7e-b77d-550ba30e8d67 tempest-TestInstancesWithCinderVolumes-797267290 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1827371626-918480955 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1827371626-918480955, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:00:31 devstack cinder-volume[87119]: WARNING cinder.quota [None req-ff387a38-23ee-4d7e-b77d-550ba30e8d67 tempest-TestInstancesWithCinderVolumes-797267290 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1827371626-918480955 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1827371626-918480955, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:00:31 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-ff387a38-23ee-4d7e-b77d-550ba30e8d67 tempest-TestInstancesWithCinderVolumes-797267290 None] Created reservations ['87b44ea7-c826-4e81-b00f-c3577cf13515', '7bc73871-a72e-4720-ac7f-7139ced8c198', '632d92e1-7c35-4563-baa6-3671f94295b4', '646ba395-60a4-44d4-957b-a9ac9a4afc3a'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:00:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ff387a38-23ee-4d7e-b77d-550ba30e8d67 tempest-TestInstancesWithCinderVolumes-797267290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ff387a38-23ee-4d7e-b77d-550ba30e8d67 tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ff387a38-23ee-4d7e-b77d-550ba30e8d67 tempest-TestInstancesWithCinderVolumes-797267290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ff387a38-23ee-4d7e-b77d-550ba30e8d67 tempest-TestInstancesWithCinderVolumes-797267290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ff387a38-23ee-4d7e-b77d-550ba30e8d67 tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ff387a38-23ee-4d7e-b77d-550ba30e8d67 tempest-TestInstancesWithCinderVolumes-797267290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:31 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:00:31 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:31 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-89492a89-d41c-455b-a0c1-e42d511bb238 tempest-GroupSnapshotsV319Test-462668689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655.info" returned: 0 in 0.329s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:31 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-89492a89-d41c-455b-a0c1-e42d511bb238 tempest-GroupSnapshotsV319Test-462668689 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 19:00:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-89492a89-d41c-455b-a0c1-e42d511bb238 tempest-GroupSnapshotsV319Test-462668689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:31 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655.info Nov 04 19:00:31 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:31 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ff387a38-23ee-4d7e-b77d-550ba30e8d67 tempest-TestInstancesWithCinderVolumes-797267290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.297s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:31 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-ff387a38-23ee-4d7e-b77d-550ba30e8d67 tempest-TestInstancesWithCinderVolumes-797267290 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:00:31 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-ff387a38-23ee-4d7e-b77d-550ba30e8d67 tempest-TestInstancesWithCinderVolumes-797267290 None] Deleted volume successfully. Nov 04 19:00:31 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ff387a38-23ee-4d7e-b77d-550ba30e8d67 tempest-TestInstancesWithCinderVolumes-797267290 None] Lock "cinder-a9acb2c9-7e09-4bd3-8741-9e51db82f1c9-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:32 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-89492a89-d41c-455b-a0c1-e42d511bb238 tempest-GroupSnapshotsV319Test-462668689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655.info" returned: 0 in 0.343s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-89492a89-d41c-455b-a0c1-e42d511bb238 tempest-GroupSnapshotsV319Test-462668689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.551s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:32 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:00:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Flow 'volume_create_manager' (4497c4b4-008e-4f43-b14b-74f55c566538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b474dc69-5da0-45f3-9d28-e17784b8ccd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b474dc69-5da0-45f3-9d28-e17784b8ccd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1344061697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d2fc119-fc82-4843-a306-ed7044e48df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94201b5cb0ab4ddc802bac3c4ddc7f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:32Z,use_quota=True,user_id='11c0f8fdf5184c12a48989e2dfbc5829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11bcbbac-908b-4bcf-9b17-b633ecf12288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11bcbbac-908b-4bcf-9b17-b633ecf12288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (357783fb-d7d3-42fc-bd88-b63edb962e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (357783fb-d7d3-42fc-bd88-b63edb962e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d2fc119-fc82-4843-a306-ed7044e48df9', 'volume_name': 'volume-5d2fc119-fc82-4843-a306-ed7044e48df9', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d777ec6-108b-489c-bbd0-e630264026c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d777ec6-108b-489c-bbd0-e630264026c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315b4f65-a5c9-4e1a-85b6-f6d5a4989554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:32 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Volume 5d2fc119-fc82-4843-a306-ed7044e48df9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d2fc119-fc82-4843-a306-ed7044e48df9', 'volume_size': 1} Nov 04 19:00:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1344061697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d2fc119-fc82-4843-a306-ed7044e48df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94201b5cb0ab4ddc802bac3c4ddc7f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:32Z,use_quota=True,user_id='11c0f8fdf5184c12a48989e2dfbc5829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:00:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Creating volume 5d2fc119-fc82-4843-a306-ed7044e48df9 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:00:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:00:32 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:00:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:32 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9 1073741824 Nov 04 19:00:32 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:32 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-89492a89-d41c-455b-a0c1-e42d511bb238 tempest-GroupSnapshotsV319Test-462668689 None] group_snapshot 73cdd45f-7c77-443c-a2a7-7f577eee90c7: created successfully Nov 04 19:00:32 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9 1073741824" returned: 0 in 0.537s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:32 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9 Nov 04 19:00:32 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:33 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9" returned: 0 in 0.420s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:00:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315b4f65-a5c9-4e1a-85b6-f6d5a4989554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d2fc119-fc82-4843-a306-ed7044e48df9', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5305d59-f8cb-4f26-aacb-4cbbf4fa6d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:33 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Volume volume-5d2fc119-fc82-4843-a306-ed7044e48df9 (5d2fc119-fc82-4843-a306-ed7044e48df9): created successfully Nov 04 19:00:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5305d59-f8cb-4f26-aacb-4cbbf4fa6d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Flow 'volume_create_manager' (4497c4b4-008e-4f43-b14b-74f55c566538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:33 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-4ba775d9-f0bf-4205-92b1-783460177288 tempest-TestStampPattern-1723885731 None] Created volume successfully. Nov 04 19:00:33 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e7b8691a-5592-479f-9200-f0bd5826013c tempest-GroupSnapshotsV319Test-462668689 None] group_snapshot 73cdd45f-7c77-443c-a2a7-7f577eee90c7: deleting Nov 04 19:00:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e7b8691a-5592-479f-9200-f0bd5826013c tempest-GroupSnapshotsV319Test-462668689 None] group_snapshot 73cdd45f-7c77-443c-a2a7-7f577eee90c7: deleting {{(pid=87119) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 04 19:00:33 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e7b8691a-5592-479f-9200-f0bd5826013c tempest-GroupSnapshotsV319Test-462668689 None] Acquiring lock "cinder-quobyte-851e118b-976d-4199-8448-d6246c2ef655" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:33 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e7b8691a-5592-479f-9200-f0bd5826013c tempest-GroupSnapshotsV319Test-462668689 None] Lock "cinder-quobyte-851e118b-976d-4199-8448-d6246c2ef655" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:33 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e7b8691a-5592-479f-9200-f0bd5826013c tempest-GroupSnapshotsV319Test-462668689 None] Acquiring lock "cinder-quobyte-96816fd7-211f-478c-bd28-b5a6068691a5" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:33 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e7b8691a-5592-479f-9200-f0bd5826013c tempest-GroupSnapshotsV319Test-462668689 None] Lock "cinder-quobyte-96816fd7-211f-478c-bd28-b5a6068691a5" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-e7b8691a-5592-479f-9200-f0bd5826013c tempest-GroupSnapshotsV319Test-462668689 None] Deleting offline snapshot 96816fd7-211f-478c-bd28-b5a6068691a5 of volume 851e118b-976d-4199-8448-d6246c2ef655 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:00:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-e7b8691a-5592-479f-9200-f0bd5826013c tempest-GroupSnapshotsV319Test-462668689 None] snapshot_file for this snap is: volume-851e118b-976d-4199-8448-d6246c2ef655.96816fd7-211f-478c-bd28-b5a6068691a5 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:00:33 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6936ab-4e75-4c87-9faa-043fa1518403]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e7b8691a-5592-479f-9200-f0bd5826013c tempest-GroupSnapshotsV319Test-462668689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655.96816fd7-211f-478c-bd28-b5a6068691a5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:33 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655.96816fd7-211f-478c-bd28-b5a6068691a5 Nov 04 19:00:33 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:34 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e7b8691a-5592-479f-9200-f0bd5826013c tempest-GroupSnapshotsV319Test-462668689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655.96816fd7-211f-478c-bd28-b5a6068691a5" returned: 0 in 0.454s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-e7b8691a-5592-479f-9200-f0bd5826013c tempest-GroupSnapshotsV319Test-462668689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-851e118b-976d-4199-8448-d6246c2ef655(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:00:34 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdd07e3-d3e0-433c-81fa-3a95c4d528de]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e7b8691a-5592-479f-9200-f0bd5826013c tempest-GroupSnapshotsV319Test-462668689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:34 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655 Nov 04 19:00:34 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:34 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e7b8691a-5592-479f-9200-f0bd5826013c tempest-GroupSnapshotsV319Test-462668689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655" returned: 0 in 0.454s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e7b8691a-5592-479f-9200-f0bd5826013c tempest-GroupSnapshotsV319Test-462668689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655.96816fd7-211f-478c-bd28-b5a6068691a5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:34 devstack sudo[101628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655.96816fd7-211f-478c-bd28-b5a6068691a5 Nov 04 19:00:34 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:35 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e7b8691a-5592-479f-9200-f0bd5826013c tempest-GroupSnapshotsV319Test-462668689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655.96816fd7-211f-478c-bd28-b5a6068691a5" returned: 0 in 0.470s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e7b8691a-5592-479f-9200-f0bd5826013c tempest-GroupSnapshotsV319Test-462668689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655.96816fd7-211f-478c-bd28-b5a6068691a5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:35 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655.96816fd7-211f-478c-bd28-b5a6068691a5 Nov 04 19:00:35 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:35 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e7b8691a-5592-479f-9200-f0bd5826013c tempest-GroupSnapshotsV319Test-462668689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655.96816fd7-211f-478c-bd28-b5a6068691a5" returned: 0 in 0.428s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:35 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e7b8691a-5592-479f-9200-f0bd5826013c tempest-GroupSnapshotsV319Test-462668689 None] Lock "cinder-quobyte-96816fd7-211f-478c-bd28-b5a6068691a5" released by "_delete_snapshot" :: held 1.949s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:35 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e7b8691a-5592-479f-9200-f0bd5826013c tempest-GroupSnapshotsV319Test-462668689 None] Lock "cinder-quobyte-851e118b-976d-4199-8448-d6246c2ef655" released by "delete_snapshot" :: held 1.984s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:35 devstack cinder-volume[87119]: WARNING cinder.quota [None req-e7b8691a-5592-479f-9200-f0bd5826013c tempest-GroupSnapshotsV319Test-462668689 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1588133504 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1588133504, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:00:35 devstack cinder-volume[87119]: WARNING cinder.quota [None req-e7b8691a-5592-479f-9200-f0bd5826013c tempest-GroupSnapshotsV319Test-462668689 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1588133504 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1588133504, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:00:35 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-e7b8691a-5592-479f-9200-f0bd5826013c tempest-GroupSnapshotsV319Test-462668689 None] Created reservations ['92768c44-a38f-49b9-8c9c-70c6400a3610', '9f6342f1-ad0b-4b34-9eb2-3eb8573b0bac', 'c06f9343-2200-4843-b241-30861bb277ce', 'c90505db-b170-4883-862e-e6726a4103c7'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:00:35 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e7b8691a-5592-479f-9200-f0bd5826013c tempest-GroupSnapshotsV319Test-462668689 None] group_snapshot 73cdd45f-7c77-443c-a2a7-7f577eee90c7: deleted successfully Nov 04 19:00:36 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-45f7f8ec-1a14-4b86-9379-3ec27fed692c tempest-GroupSnapshotsV319Test-462668689 None] Acquiring lock "cinder-quobyte-851e118b-976d-4199-8448-d6246c2ef655" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:36 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-45f7f8ec-1a14-4b86-9379-3ec27fed692c tempest-GroupSnapshotsV319Test-462668689 None] Lock "cinder-quobyte-851e118b-976d-4199-8448-d6246c2ef655" acquired by "delete_volume" :: waited 0.019s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:36 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb99f5f-8982-47a7-b241-47fd73d12222]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-45f7f8ec-1a14-4b86-9379-3ec27fed692c tempest-GroupSnapshotsV319Test-462668689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:36 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655 Nov 04 19:00:36 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:36 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-45f7f8ec-1a14-4b86-9379-3ec27fed692c tempest-GroupSnapshotsV319Test-462668689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655" returned: 0 in 0.399s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-45f7f8ec-1a14-4b86-9379-3ec27fed692c tempest-GroupSnapshotsV319Test-462668689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:36 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655 Nov 04 19:00:36 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:36 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-45f7f8ec-1a14-4b86-9379-3ec27fed692c tempest-GroupSnapshotsV319Test-462668689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-851e118b-976d-4199-8448-d6246c2ef655" returned: 0 in 0.326s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:36 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-45f7f8ec-1a14-4b86-9379-3ec27fed692c tempest-GroupSnapshotsV319Test-462668689 None] Lock "cinder-quobyte-851e118b-976d-4199-8448-d6246c2ef655" released by "delete_volume" :: held 0.850s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:37 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-45f7f8ec-1a14-4b86-9379-3ec27fed692c tempest-GroupSnapshotsV319Test-462668689 None] Created reservations ['c1b892d4-c2cb-43aa-8d7b-0b7a7dd07c74'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:00:37 devstack cinder-volume[87119]: WARNING cinder.quota [None req-45f7f8ec-1a14-4b86-9379-3ec27fed692c tempest-GroupSnapshotsV319Test-462668689 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1588133504 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1588133504, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:00:37 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-45f7f8ec-1a14-4b86-9379-3ec27fed692c tempest-GroupSnapshotsV319Test-462668689 None] Created reservations ['d6504595-8870-441b-85e6-dcfe06eaa240', '8056e26e-32c7-4d18-97c1-ad53dfd0b4dc', '73e37203-1238-43a1-90f1-12fee7f56417', '20bff527-2706-4af2-b3ba-23dbfc19cd21'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:00:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-45f7f8ec-1a14-4b86-9379-3ec27fed692c tempest-GroupSnapshotsV319Test-462668689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-45f7f8ec-1a14-4b86-9379-3ec27fed692c tempest-GroupSnapshotsV319Test-462668689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-45f7f8ec-1a14-4b86-9379-3ec27fed692c tempest-GroupSnapshotsV319Test-462668689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-45f7f8ec-1a14-4b86-9379-3ec27fed692c tempest-GroupSnapshotsV319Test-462668689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-45f7f8ec-1a14-4b86-9379-3ec27fed692c tempest-GroupSnapshotsV319Test-462668689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-45f7f8ec-1a14-4b86-9379-3ec27fed692c tempest-GroupSnapshotsV319Test-462668689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:37 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:00:37 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:37 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-45f7f8ec-1a14-4b86-9379-3ec27fed692c tempest-GroupSnapshotsV319Test-462668689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.616s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:37 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-45f7f8ec-1a14-4b86-9379-3ec27fed692c tempest-GroupSnapshotsV319Test-462668689 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:00:37 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-45f7f8ec-1a14-4b86-9379-3ec27fed692c tempest-GroupSnapshotsV319Test-462668689 None] Delete group completed successfully. Nov 04 19:00:44 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-c8fd8eb0-1d4b-4ef1-8211-32d983c5cd37 req-b0f4c22f-f2cc-46e3-9cb7-01c2fd94f90d tempest-TestMinimumBasicScenario-1667222313 None] Terminate volume connection completed successfully. Nov 04 19:00:44 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-c8fd8eb0-1d4b-4ef1-8211-32d983c5cd37 req-b0f4c22f-f2cc-46e3-9cb7-01c2fd94f90d tempest-TestMinimumBasicScenario-1667222313 None] Deleting attachment b9fc6a6f-40f3-44e7-a18d-3a26990b51e8. {{(pid=87119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:00:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-048bea8c-3aaa-4e98-a7c7-d90528bdecf2 tempest-TestMinimumBasicScenario-1667222313 None] Acquiring lock "cinder-bb15badb-1d5e-4471-81fe-46545ea48f92-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-048bea8c-3aaa-4e98-a7c7-d90528bdecf2 tempest-TestMinimumBasicScenario-1667222313 None] Lock "cinder-bb15badb-1d5e-4471-81fe-46545ea48f92-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-048bea8c-3aaa-4e98-a7c7-d90528bdecf2 tempest-TestMinimumBasicScenario-1667222313 None] Acquiring lock "cinder-quobyte-bb15badb-1d5e-4471-81fe-46545ea48f92" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-048bea8c-3aaa-4e98-a7c7-d90528bdecf2 tempest-TestMinimumBasicScenario-1667222313 None] Lock "cinder-quobyte-bb15badb-1d5e-4471-81fe-46545ea48f92" acquired by "delete_volume" :: waited 0.027s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:45 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcb0d77-d153-406c-9210-078ee03e2c9c]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-048bea8c-3aaa-4e98-a7c7-d90528bdecf2 tempest-TestMinimumBasicScenario-1667222313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bb15badb-1d5e-4471-81fe-46545ea48f92 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:45 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bb15badb-1d5e-4471-81fe-46545ea48f92 Nov 04 19:00:45 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:46 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-048bea8c-3aaa-4e98-a7c7-d90528bdecf2 tempest-TestMinimumBasicScenario-1667222313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bb15badb-1d5e-4471-81fe-46545ea48f92" returned: 0 in 0.582s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-048bea8c-3aaa-4e98-a7c7-d90528bdecf2 tempest-TestMinimumBasicScenario-1667222313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bb15badb-1d5e-4471-81fe-46545ea48f92 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:46 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bb15badb-1d5e-4471-81fe-46545ea48f92 Nov 04 19:00:46 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:46 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-048bea8c-3aaa-4e98-a7c7-d90528bdecf2 tempest-TestMinimumBasicScenario-1667222313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-bb15badb-1d5e-4471-81fe-46545ea48f92" returned: 0 in 0.593s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-048bea8c-3aaa-4e98-a7c7-d90528bdecf2 tempest-TestMinimumBasicScenario-1667222313 None] Lock "cinder-quobyte-bb15badb-1d5e-4471-81fe-46545ea48f92" released by "delete_volume" :: held 1.227s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:47 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-048bea8c-3aaa-4e98-a7c7-d90528bdecf2 tempest-TestMinimumBasicScenario-1667222313 None] Created reservations ['2da2cb3c-e6ce-4b42-876f-b70d31a589f7', '692cc9db-153b-4af1-bc2d-ff446986b867', '68b2c055-73ae-4956-a991-b5f6a0202e82', 'cd14e850-7b2f-40d0-98e9-d670a7603229'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:00:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-048bea8c-3aaa-4e98-a7c7-d90528bdecf2 tempest-TestMinimumBasicScenario-1667222313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-048bea8c-3aaa-4e98-a7c7-d90528bdecf2 tempest-TestMinimumBasicScenario-1667222313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-048bea8c-3aaa-4e98-a7c7-d90528bdecf2 tempest-TestMinimumBasicScenario-1667222313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-048bea8c-3aaa-4e98-a7c7-d90528bdecf2 tempest-TestMinimumBasicScenario-1667222313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-048bea8c-3aaa-4e98-a7c7-d90528bdecf2 tempest-TestMinimumBasicScenario-1667222313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-048bea8c-3aaa-4e98-a7c7-d90528bdecf2 tempest-TestMinimumBasicScenario-1667222313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:47 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:00:47 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:47 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-048bea8c-3aaa-4e98-a7c7-d90528bdecf2 tempest-TestMinimumBasicScenario-1667222313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.404s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:47 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-048bea8c-3aaa-4e98-a7c7-d90528bdecf2 tempest-TestMinimumBasicScenario-1667222313 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:00:47 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-048bea8c-3aaa-4e98-a7c7-d90528bdecf2 tempest-TestMinimumBasicScenario-1667222313 None] Deleted volume successfully. Nov 04 19:00:47 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-048bea8c-3aaa-4e98-a7c7-d90528bdecf2 tempest-TestMinimumBasicScenario-1667222313 None] Lock "cinder-bb15badb-1d5e-4471-81fe-46545ea48f92-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:51 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-413b6121-d615-46e2-8fff-0ef01de9b919 tempest-GroupsV314Test-233828896 None] Group tempest-GroupsV314Test-Group-1724462299: creating Nov 04 19:00:51 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-413b6121-d615-46e2-8fff-0ef01de9b919 tempest-GroupsV314Test-233828896 None] Group tempest-GroupsV314Test-Group-1724462299: created successfully Nov 04 19:00:51 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-413b6121-d615-46e2-8fff-0ef01de9b919 tempest-GroupsV314Test-233828896 None] Create group completed successfully. Nov 04 19:00:53 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:00:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Flow 'volume_create_manager' (137f6c1d-8bb5-4a83-9ef3-abc3d4c4ffba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d09f80f4-86c4-4d53-a93e-1d77d1ce7935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d09f80f4-86c4-4d53-a93e-1d77d1ce7935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2026511315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa0887a9-34c3-446e-bf9a-69001502cd8c,host='devstack@QuobyteHD#QuobyteHD',id=743f6819-54bc-4156-9463-ed47ae075b15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='143a93fe9f0c4f2db135fc8a49610cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:53Z,use_quota=True,user_id='1b61704ad52d425fab95ce27f888da0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee69323b-667a-41ee-b79c-6045c7da6aa2),volume_type_id=ee69323b-667a-41ee-b79c-6045c7da6aa2)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a36962-9165-4c08-80cb-4a5175ca2f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a36962-9165-4c08-80cb-4a5175ca2f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f74d6b82-25fe-4de5-9831-185df879849e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f74d6b82-25fe-4de5-9831-185df879849e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '743f6819-54bc-4156-9463-ed47ae075b15', 'volume_name': 'volume-743f6819-54bc-4156-9463-ed47ae075b15', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f453034a-8286-40d7-8f3b-1da04dc96a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f453034a-8286-40d7-8f3b-1da04dc96a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c629fd52-27df-4419-b23d-cf0c5f97165e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:53 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Volume 743f6819-54bc-4156-9463-ed47ae075b15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-743f6819-54bc-4156-9463-ed47ae075b15', 'volume_size': 1} Nov 04 19:00:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:53 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fa0887a9-34c3-446e-bf9a-69001502cd8c,created_at=2026-11-04T18:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2026511315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa0887a9-34c3-446e-bf9a-69001502cd8c,host='devstack@QuobyteHD#QuobyteHD',id=743f6819-54bc-4156-9463-ed47ae075b15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='143a93fe9f0c4f2db135fc8a49610cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:53Z,use_quota=True,user_id='1b61704ad52d425fab95ce27f888da0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee69323b-667a-41ee-b79c-6045c7da6aa2),volume_type_id=ee69323b-667a-41ee-b79c-6045c7da6aa2)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:00:53 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Creating volume 743f6819-54bc-4156-9463-ed47ae075b15 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:00:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:53 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:53 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:53 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:00:53 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:00:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:53 devstack sudo[101854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15 1073741824 Nov 04 19:00:53 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:53 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15 1073741824" returned: 0 in 0.508s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:53 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15 Nov 04 19:00:53 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:54 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15" returned: 0 in 0.271s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:54 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:00:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:54 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c629fd52-27df-4419-b23d-cf0c5f97165e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-743f6819-54bc-4156-9463-ed47ae075b15', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:54 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52260f6b-2b52-4d30-ad83-73fde0c5ff92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:54 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Volume volume-743f6819-54bc-4156-9463-ed47ae075b15 (743f6819-54bc-4156-9463-ed47ae075b15): created successfully Nov 04 19:00:54 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52260f6b-2b52-4d30-ad83-73fde0c5ff92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:54 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Flow 'volume_create_manager' (137f6c1d-8bb5-4a83-9ef3-abc3d4c4ffba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:54 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-0f815a41-b476-49d3-b802-e602b1b629e1 tempest-GroupsV314Test-233828896 None] Created volume successfully. Nov 04 19:00:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:55 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Cloning volume 743f6819-54bc-4156-9463-ed47ae075b15 to volume 56b06c3d-1db3-448f-892b-f2e0b464bf55 Nov 04 19:00:55 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Creating offline snapshot f7118154-fe36-499e-a8c0-e9b53825b10f of volume 743f6819-54bc-4156-9463-ed47ae075b15 {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:00:55 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca241e3-c448-4787-9f4a-5dbaf9cfdf6f]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:55 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15 Nov 04 19:00:55 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:55 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15" returned: 0 in 0.454s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.f7118154-fe36-499e-a8c0-e9b53825b10f 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:55 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.f7118154-fe36-499e-a8c0-e9b53825b10f 1G Nov 04 19:00:55 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:56 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.f7118154-fe36-499e-a8c0-e9b53825b10f 1G" returned: 0 in 0.470s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-743f6819-54bc-4156-9463-ed47ae075b15 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.f7118154-fe36-499e-a8c0-e9b53825b10f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:56 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-743f6819-54bc-4156-9463-ed47ae075b15 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.f7118154-fe36-499e-a8c0-e9b53825b10f Nov 04 19:00:56 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:56 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-743f6819-54bc-4156-9463-ed47ae075b15 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.f7118154-fe36-499e-a8c0-e9b53825b10f" returned: 0 in 0.364s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:56 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.f7118154-fe36-499e-a8c0-e9b53825b10f is being set with open permissions: ugo+rw: NotImplementedError Nov 04 19:00:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.f7118154-fe36-499e-a8c0-e9b53825b10f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:56 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.f7118154-fe36-499e-a8c0-e9b53825b10f Nov 04 19:00:56 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:56 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.f7118154-fe36-499e-a8c0-e9b53825b10f" returned: 0 in 0.264s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:56 devstack sudo[101883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.info Nov 04 19:00:56 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:57 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.info" returned: 0 in 0.307s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:57 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 19:00:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:57 devstack sudo[101886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.info Nov 04 19:00:57 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:57 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.info" returned: 0 in 0.316s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:57 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Acquiring lock "cinder-quobyte-56b06c3d-1db3-448f-892b-f2e0b464bf55" by "_copy_volume_from_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:57 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Lock "cinder-quobyte-56b06c3d-1db3-448f-892b-f2e0b464bf55" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] snapshot: f7118154-fe36-499e-a8c0-e9b53825b10f, volume: 56b06c3d-1db3-448f-892b-f2e0b464bf55, {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:00:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:57 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edb2229-9d6c-409b-8f2c-4b0417ef98d5]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.f7118154-fe36-499e-a8c0-e9b53825b10f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:57 devstack sudo[101890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.f7118154-fe36-499e-a8c0-e9b53825b10f Nov 04 19:00:57 devstack sudo[101890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:57 devstack sudo[101890]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.f7118154-fe36-499e-a8c0-e9b53825b10f" returned: 0 in 0.454s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:58 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-743f6819-54bc-4156-9463-ed47ae075b15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:00:58 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b15ba5a-57be-46b2-8491-7b6bab2cfcb8]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:58 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15 Nov 04 19:00:58 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:58 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15" returned: 0 in 0.467s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:58 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15 {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:00:58 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Creating direct copy from snapshot {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:00:58 devstack cinder-volume[87119]: DEBUG cinder.utils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Path /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-56b06c3d-1db3-448f-892b-f2e0b464bf55 not found in is_blk_device check {{(pid=87119) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:00:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-56b06c3d-1db3-448f-892b-f2e0b464bf55 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:58 devstack sudo[101901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-56b06c3d-1db3-448f-892b-f2e0b464bf55 Nov 04 19:00:58 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:06 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=83,cinder:UPDATE=95,cinder:INSERT=28,cinder:DELETE=6 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:01:06 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=103,cinder:UPDATE=102,cinder:DELETE=7,cinder:INSERT=18 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:01:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-56b06c3d-1db3-448f-892b-f2e0b464bf55" returned: 0 in 9.037s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:07 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Image conversion details: src /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15, size 1024.00 MB, duration 9.04 sec, destination /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-56b06c3d-1db3-448f-892b-f2e0b464bf55 {{(pid=87119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:01:07 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Converted 1024.00 MB image at 113.29 MB/s Nov 04 19:01:07 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-56b06c3d-1db3-448f-892b-f2e0b464bf55 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 19:01:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-56b06c3d-1db3-448f-892b-f2e0b464bf55 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-3188f8bf-7405-47bd-9c89-2b02b5748420 req-30740854-8338-45aa-874a-33ef36bb0971 tempest-TestStampPattern-1723885731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:07 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-56b06c3d-1db3-448f-892b-f2e0b464bf55 Nov 04 19:01:07 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:07 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-56b06c3d-1db3-448f-892b-f2e0b464bf55" returned: 0 in 0.320s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Lock "cinder-quobyte-56b06c3d-1db3-448f-892b-f2e0b464bf55" released by "_copy_volume_from_snapshot" :: held 10.375s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Acquiring lock "cinder-quobyte-f7118154-fe36-499e-a8c0-e9b53825b10f" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Lock "cinder-quobyte-f7118154-fe36-499e-a8c0-e9b53825b10f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Deleting offline snapshot f7118154-fe36-499e-a8c0-e9b53825b10f of volume 743f6819-54bc-4156-9463-ed47ae075b15 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:01:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] snapshot_file for this snap is: volume-743f6819-54bc-4156-9463-ed47ae075b15.f7118154-fe36-499e-a8c0-e9b53825b10f {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:01:07 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb61b55-ab31-4cc4-9645-d31d2cccf382]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.f7118154-fe36-499e-a8c0-e9b53825b10f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:08 devstack sudo[101938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.f7118154-fe36-499e-a8c0-e9b53825b10f Nov 04 19:01:08 devstack sudo[101938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:08 devstack sudo[101938]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.f7118154-fe36-499e-a8c0-e9b53825b10f" returned: 0 in 0.435s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-743f6819-54bc-4156-9463-ed47ae075b15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:01:08 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6eb5e5-9d6e-429a-9002-357cc236f62d]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:08 devstack sudo[101943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15 Nov 04 19:01:08 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:09 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15" returned: 0 in 0.595s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.f7118154-fe36-499e-a8c0-e9b53825b10f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:09 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.f7118154-fe36-499e-a8c0-e9b53825b10f Nov 04 19:01:09 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:09 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.f7118154-fe36-499e-a8c0-e9b53825b10f" returned: 0 in 0.412s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.f7118154-fe36-499e-a8c0-e9b53825b10f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:09 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.f7118154-fe36-499e-a8c0-e9b53825b10f Nov 04 19:01:09 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:09 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15.f7118154-fe36-499e-a8c0-e9b53825b10f" returned: 0 in 0.283s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Lock "cinder-quobyte-f7118154-fe36-499e-a8c0-e9b53825b10f" released by "_delete_snapshot" :: held 1.864s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.678s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-3188f8bf-7405-47bd-9c89-2b02b5748420 req-30740854-8338-45aa-874a-33ef36bb0971 tempest-TestStampPattern-1723885731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.229s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-3188f8bf-7405-47bd-9c89-2b02b5748420 req-30740854-8338-45aa-874a-33ef36bb0971 tempest-TestStampPattern-1723885731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-3188f8bf-7405-47bd-9c89-2b02b5748420 req-30740854-8338-45aa-874a-33ef36bb0971 tempest-TestStampPattern-1723885731 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280', 'name': 'volume-5d2fc119-fc82-4843-a306-ed7044e48df9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '81e3b64c-c340-4b08-89d0-80d340adc9e3', 'enforce_multipath': True} {{(pid=87119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:01:10 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-f55603b2-1da8-48d8-b854-733472425fde tempest-GroupsV314Test-233828896 None] Create group from source-group-fa0887a9-34c3-446e-bf9a-69001502cd8c completed successfully. Nov 04 19:01:10 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-3188f8bf-7405-47bd-9c89-2b02b5748420 req-30740854-8338-45aa-874a-33ef36bb0971 tempest-TestStampPattern-1723885731 None] attachment_update completed successfully. Nov 04 19:01:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-94f4dc30-9ab9-40f4-bdde-0968de6e74a8 tempest-GroupsV314Test-233828896 None] Acquiring lock "cinder-quobyte-56b06c3d-1db3-448f-892b-f2e0b464bf55" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-94f4dc30-9ab9-40f4-bdde-0968de6e74a8 tempest-GroupsV314Test-233828896 None] Lock "cinder-quobyte-56b06c3d-1db3-448f-892b-f2e0b464bf55" acquired by "delete_volume" :: waited 0.060s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:10 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff3072d-d83d-4995-83bf-6dd454edbab3]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-94f4dc30-9ab9-40f4-bdde-0968de6e74a8 tempest-GroupsV314Test-233828896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-56b06c3d-1db3-448f-892b-f2e0b464bf55 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:11 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-56b06c3d-1db3-448f-892b-f2e0b464bf55 Nov 04 19:01:11 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:11 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-94f4dc30-9ab9-40f4-bdde-0968de6e74a8 tempest-GroupsV314Test-233828896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-56b06c3d-1db3-448f-892b-f2e0b464bf55" returned: 0 in 0.468s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-94f4dc30-9ab9-40f4-bdde-0968de6e74a8 tempest-GroupsV314Test-233828896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-56b06c3d-1db3-448f-892b-f2e0b464bf55 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:11 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-56b06c3d-1db3-448f-892b-f2e0b464bf55 Nov 04 19:01:11 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:11 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-94f4dc30-9ab9-40f4-bdde-0968de6e74a8 tempest-GroupsV314Test-233828896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-56b06c3d-1db3-448f-892b-f2e0b464bf55" returned: 0 in 0.288s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:11 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-94f4dc30-9ab9-40f4-bdde-0968de6e74a8 tempest-GroupsV314Test-233828896 None] Lock "cinder-quobyte-56b06c3d-1db3-448f-892b-f2e0b464bf55" released by "delete_volume" :: held 0.855s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:11 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-94f4dc30-9ab9-40f4-bdde-0968de6e74a8 tempest-GroupsV314Test-233828896 None] Created reservations ['85beed62-037f-4a46-bc09-4ad2314ddd0e'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:11 devstack cinder-volume[87119]: WARNING cinder.quota [None req-94f4dc30-9ab9-40f4-bdde-0968de6e74a8 tempest-GroupsV314Test-233828896 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-675438720 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-675438720, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:01:11 devstack cinder-volume[87119]: WARNING cinder.quota [None req-94f4dc30-9ab9-40f4-bdde-0968de6e74a8 tempest-GroupsV314Test-233828896 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-675438720 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-675438720, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:01:11 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-94f4dc30-9ab9-40f4-bdde-0968de6e74a8 tempest-GroupsV314Test-233828896 None] Created reservations ['441a72fb-b1a7-4863-be21-d34bdfcbdfcd', 'b1cfd1da-9d4f-4370-a684-921c8ca5ed08', '13c6d592-701a-405e-bd33-7c92862ac3d7', '21a25a28-4fe1-43dd-bdcf-de54584137b1'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-94f4dc30-9ab9-40f4-bdde-0968de6e74a8 tempest-GroupsV314Test-233828896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-94f4dc30-9ab9-40f4-bdde-0968de6e74a8 tempest-GroupsV314Test-233828896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:12 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-94f4dc30-9ab9-40f4-bdde-0968de6e74a8 tempest-GroupsV314Test-233828896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:12 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-94f4dc30-9ab9-40f4-bdde-0968de6e74a8 tempest-GroupsV314Test-233828896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-94f4dc30-9ab9-40f4-bdde-0968de6e74a8 tempest-GroupsV314Test-233828896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-94f4dc30-9ab9-40f4-bdde-0968de6e74a8 tempest-GroupsV314Test-233828896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:12 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:01:12 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:12 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-94f4dc30-9ab9-40f4-bdde-0968de6e74a8 tempest-GroupsV314Test-233828896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.408s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:12 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-94f4dc30-9ab9-40f4-bdde-0968de6e74a8 tempest-GroupsV314Test-233828896 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:01:12 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-94f4dc30-9ab9-40f4-bdde-0968de6e74a8 tempest-GroupsV314Test-233828896 None] Delete group completed successfully. Nov 04 19:01:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-96d82464-9a77-4eeb-a298-e2e6048d4945 tempest-GroupsV314Test-233828896 None] Acquiring lock "cinder-quobyte-743f6819-54bc-4156-9463-ed47ae075b15" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-96d82464-9a77-4eeb-a298-e2e6048d4945 tempest-GroupsV314Test-233828896 None] Lock "cinder-quobyte-743f6819-54bc-4156-9463-ed47ae075b15" acquired by "delete_volume" :: waited 0.030s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:12 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c33b1b-6293-4852-89de-05251bbbbd20]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-96d82464-9a77-4eeb-a298-e2e6048d4945 tempest-GroupsV314Test-233828896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:12 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15 Nov 04 19:01:12 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:13 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-96d82464-9a77-4eeb-a298-e2e6048d4945 tempest-GroupsV314Test-233828896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15" returned: 0 in 0.605s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-96d82464-9a77-4eeb-a298-e2e6048d4945 tempest-GroupsV314Test-233828896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:13 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15 Nov 04 19:01:13 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:13 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-96d82464-9a77-4eeb-a298-e2e6048d4945 tempest-GroupsV314Test-233828896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-743f6819-54bc-4156-9463-ed47ae075b15" returned: 0 in 0.484s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:13 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-96d82464-9a77-4eeb-a298-e2e6048d4945 tempest-GroupsV314Test-233828896 None] Lock "cinder-quobyte-743f6819-54bc-4156-9463-ed47ae075b15" released by "delete_volume" :: held 1.232s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:14 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-96d82464-9a77-4eeb-a298-e2e6048d4945 tempest-GroupsV314Test-233828896 None] Created reservations ['6616040e-6d2e-4985-b6d3-f50dc8748fd3'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:14 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-96d82464-9a77-4eeb-a298-e2e6048d4945 tempest-GroupsV314Test-233828896 None] Created reservations ['aa721493-f8cc-4462-b866-051c3c33632f', 'cfe0a259-7ca3-40e6-991d-a3cb3964438b', '0f640a42-b408-4eba-a66e-f14595a78e10', '42a763a0-a5da-46a5-9535-5811f438f809'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-96d82464-9a77-4eeb-a298-e2e6048d4945 tempest-GroupsV314Test-233828896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-96d82464-9a77-4eeb-a298-e2e6048d4945 tempest-GroupsV314Test-233828896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-96d82464-9a77-4eeb-a298-e2e6048d4945 tempest-GroupsV314Test-233828896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-96d82464-9a77-4eeb-a298-e2e6048d4945 tempest-GroupsV314Test-233828896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-96d82464-9a77-4eeb-a298-e2e6048d4945 tempest-GroupsV314Test-233828896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-96d82464-9a77-4eeb-a298-e2e6048d4945 tempest-GroupsV314Test-233828896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:14 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:01:14 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:14 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-96d82464-9a77-4eeb-a298-e2e6048d4945 tempest-GroupsV314Test-233828896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.353s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:14 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-96d82464-9a77-4eeb-a298-e2e6048d4945 tempest-GroupsV314Test-233828896 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:01:14 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-96d82464-9a77-4eeb-a298-e2e6048d4945 tempest-GroupsV314Test-233828896 None] Delete group completed successfully. Nov 04 19:01:16 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-86acba11-02a0-4a71-a980-e4b75f2aea75 req-df3c0634-5453-447b-bee9-29c6322d12f0 tempest-TestStampPattern-1723885731 None] Terminate volume connection completed successfully. Nov 04 19:01:16 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-86acba11-02a0-4a71-a980-e4b75f2aea75 req-df3c0634-5453-447b-bee9-29c6322d12f0 tempest-TestStampPattern-1723885731 None] Deleting attachment 81e3b64c-c340-4b08-89d0-80d340adc9e3. {{(pid=87119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:01:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e5969e57-cef2-4181-8d9a-b4144dc5db0f tempest-TestStampPattern-1723885731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e5969e57-cef2-4181-8d9a-b4144dc5db0f tempest-TestStampPattern-1723885731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:17 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-e5969e57-cef2-4181-8d9a-b4144dc5db0f tempest-TestStampPattern-1723885731 None] Creating offline snapshot da00fcf4-8284-4947-ae03-7488c14a703f of volume 5d2fc119-fc82-4843-a306-ed7044e48df9 {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:01:17 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a9370e-6579-404a-a062-f4a6167e16c8]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5969e57-cef2-4181-8d9a-b4144dc5db0f tempest-TestStampPattern-1723885731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:17 devstack sudo[102454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9 Nov 04 19:01:17 devstack sudo[102454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:17 devstack sudo[102454]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5969e57-cef2-4181-8d9a-b4144dc5db0f tempest-TestStampPattern-1723885731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9" returned: 0 in 0.416s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5969e57-cef2-4181-8d9a-b4144dc5db0f tempest-TestStampPattern-1723885731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.da00fcf4-8284-4947-ae03-7488c14a703f 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:17 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.da00fcf4-8284-4947-ae03-7488c14a703f 1G Nov 04 19:01:17 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:18 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5969e57-cef2-4181-8d9a-b4144dc5db0f tempest-TestStampPattern-1723885731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.da00fcf4-8284-4947-ae03-7488c14a703f 1G" returned: 0 in 0.468s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5969e57-cef2-4181-8d9a-b4144dc5db0f tempest-TestStampPattern-1723885731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d2fc119-fc82-4843-a306-ed7044e48df9 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.da00fcf4-8284-4947-ae03-7488c14a703f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:18 devstack sudo[102464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d2fc119-fc82-4843-a306-ed7044e48df9 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.da00fcf4-8284-4947-ae03-7488c14a703f Nov 04 19:01:18 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:18 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5969e57-cef2-4181-8d9a-b4144dc5db0f tempest-TestStampPattern-1723885731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d2fc119-fc82-4843-a306-ed7044e48df9 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.da00fcf4-8284-4947-ae03-7488c14a703f" returned: 0 in 0.333s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:18 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-e5969e57-cef2-4181-8d9a-b4144dc5db0f tempest-TestStampPattern-1723885731 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.da00fcf4-8284-4947-ae03-7488c14a703f is being set with open permissions: ugo+rw Nov 04 19:01:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5969e57-cef2-4181-8d9a-b4144dc5db0f tempest-TestStampPattern-1723885731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.da00fcf4-8284-4947-ae03-7488c14a703f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:18 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.da00fcf4-8284-4947-ae03-7488c14a703f Nov 04 19:01:18 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:18 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5969e57-cef2-4181-8d9a-b4144dc5db0f tempest-TestStampPattern-1723885731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.da00fcf4-8284-4947-ae03-7488c14a703f" returned: 0 in 0.339s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5969e57-cef2-4181-8d9a-b4144dc5db0f tempest-TestStampPattern-1723885731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:19 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.info Nov 04 19:01:19 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:19 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5969e57-cef2-4181-8d9a-b4144dc5db0f tempest-TestStampPattern-1723885731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.info" returned: 0 in 0.369s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:19 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-e5969e57-cef2-4181-8d9a-b4144dc5db0f tempest-TestStampPattern-1723885731 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.info is being set with open permissions: ugo+rw Nov 04 19:01:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5969e57-cef2-4181-8d9a-b4144dc5db0f tempest-TestStampPattern-1723885731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:19 devstack sudo[102476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.info Nov 04 19:01:19 devstack sudo[102476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:19 devstack sudo[102476]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5969e57-cef2-4181-8d9a-b4144dc5db0f tempest-TestStampPattern-1723885731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.info" returned: 0 in 0.290s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e5969e57-cef2-4181-8d9a-b4144dc5db0f tempest-TestStampPattern-1723885731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.355s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:19 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e5969e57-cef2-4181-8d9a-b4144dc5db0f tempest-TestStampPattern-1723885731 None] Create snapshot completed successfully Nov 04 19:01:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:01:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:25 devstack sudo[102508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:01:25 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:25 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.397s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:25 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:01:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager._thread_info {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:01:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread count: 28 {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:01:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread info: [<_MainThread(MainThread, started 130247852032128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Flow 'volume_create_manager' (63ee3a16-d86c-4506-9e66-801e0e9a338e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f92143-d9a2-4bae-a138-3cbc54d370b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f92143-d9a2-4bae-a138-3cbc54d370b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-361938980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6d03f70-5d17-4f4b-a950-effc329c851f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94201b5cb0ab4ddc802bac3c4ddc7f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=da00fcf4-8284-4947-ae03-7488c14a703f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:01:29Z,use_quota=True,user_id='11c0f8fdf5184c12a48989e2dfbc5829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd03d7ce-4ac6-474e-8fcb-ae560b6ab53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd03d7ce-4ac6-474e-8fcb-ae560b6ab53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8b94e43-2a0e-42a3-af28-43d252d58bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8b94e43-2a0e-42a3-af28-43d252d58bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f6d03f70-5d17-4f4b-a950-effc329c851f', 'volume_name': 'volume-f6d03f70-5d17-4f4b-a950-effc329c851f', 'volume_size': 1, 'snapshot_id': 'da00fcf4-8284-4947-ae03-7488c14a703f'}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e7028e-6bab-4bb3-9ebd-49a43112a8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e7028e-6bab-4bb3-9ebd-49a43112a8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141ac10a-8062-41ec-85d2-61c44ad0e1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:29 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Volume f6d03f70-5d17-4f4b-a950-effc329c851f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f6d03f70-5d17-4f4b-a950-effc329c851f', 'volume_size': 1, 'snapshot_id': 'da00fcf4-8284-4947-ae03-7488c14a703f'} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Acquiring lock "cinder-quobyte-da00fcf4-8284-4947-ae03-7488c14a703f-f6d03f70-5d17-4f4b-a950-effc329c851f" by "_create_volume_from_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Lock "cinder-quobyte-da00fcf4-8284-4947-ae03-7488c14a703f-f6d03f70-5d17-4f4b-a950-effc329c851f" acquired by "_create_volume_from_snapshot" :: waited 0.054s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Creating volume f6d03f70-5d17-4f4b-a950-effc329c851f from snapshot da00fcf4-8284-4947-ae03-7488c14a703f {{(pid=87119) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Acquiring lock "cinder-quobyte-f6d03f70-5d17-4f4b-a950-effc329c851f" by "_copy_volume_from_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Lock "cinder-quobyte-f6d03f70-5d17-4f4b-a950-effc329c851f" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] snapshot: da00fcf4-8284-4947-ae03-7488c14a703f, volume: f6d03f70-5d17-4f4b-a950-effc329c851f, {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b31c57-49eb-4261-b81d-82b0009679f2]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.da00fcf4-8284-4947-ae03-7488c14a703f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:29 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.da00fcf4-8284-4947-ae03-7488c14a703f Nov 04 19:01:29 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:29 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.da00fcf4-8284-4947-ae03-7488c14a703f" returned: 0 in 0.592s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d2fc119-fc82-4843-a306-ed7044e48df9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:01:30 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b132e32-e2da-4b8b-a502-4cff6729aaf0]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:30 devstack sudo[102520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9 Nov 04 19:01:30 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:30 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9" returned: 0 in 0.456s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:30 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9 {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:01:30 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Creating direct copy from snapshot {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:01:30 devstack cinder-volume[87119]: DEBUG cinder.utils [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Path /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f6d03f70-5d17-4f4b-a950-effc329c851f not found in is_blk_device check {{(pid=87119) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:01:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f6d03f70-5d17-4f4b-a950-effc329c851f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:30 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f6d03f70-5d17-4f4b-a950-effc329c851f Nov 04 19:01:30 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:39 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=28,cinder:UPDATE=32,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:01:39 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=35,cinder:UPDATE=25,cinder:INSERT=5 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:01:39 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f6d03f70-5d17-4f4b-a950-effc329c851f" returned: 0 in 9.126s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:39 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Image conversion details: src /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9, size 1024.00 MB, duration 9.13 sec, destination /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f6d03f70-5d17-4f4b-a950-effc329c851f {{(pid=87119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:01:39 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Converted 1024.00 MB image at 112.14 MB/s Nov 04 19:01:39 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f6d03f70-5d17-4f4b-a950-effc329c851f is being set with open permissions: ugo+rw Nov 04 19:01:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f6d03f70-5d17-4f4b-a950-effc329c851f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:39 devstack sudo[102549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f6d03f70-5d17-4f4b-a950-effc329c851f Nov 04 19:01:39 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:39 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:01:39 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:39 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Flow 'volume_create_manager' (8a78b955-64f9-414f-8064-36530a9a97ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:01:39 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19398eb4-0a6d-4f0e-9498-4796d45400b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f6d03f70-5d17-4f4b-a950-effc329c851f" returned: 0 in 0.346s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:39 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Lock "cinder-quobyte-f6d03f70-5d17-4f4b-a950-effc329c851f" released by "_copy_volume_from_snapshot" :: held 10.682s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19398eb4-0a6d-4f0e-9498-4796d45400b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1658530013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8de23c4-6c3e-44e5-8277-10eaeb2abf1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='155cad4fe8b141b2a6e9d2ca898ca96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:01:40Z,use_quota=True,user_id='c8fede472ee74683917ec0c25ba0f911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f0f335-adca-47a4-a6bf-c83e872659e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f0f335-adca-47a4-a6bf-c83e872659e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de28c6f5-0866-40dd-bb7e-715197d85aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de28c6f5-0866-40dd-bb7e-715197d85aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8de23c4-6c3e-44e5-8277-10eaeb2abf1d', 'volume_name': 'volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e131639-e747-422a-8b22-fc8994dcc880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e131639-e747-422a-8b22-fc8994dcc880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (578ea737-7d4a-47bd-af0f-93c04d546075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:40 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Volume e8de23c4-6c3e-44e5-8277-10eaeb2abf1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d', 'volume_size': 1} Nov 04 19:01:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Lock "cinder-quobyte-da00fcf4-8284-4947-ae03-7488c14a703f-f6d03f70-5d17-4f4b-a950-effc329c851f" released by "_create_volume_from_snapshot" :: held 10.868s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.923s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.056s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:40 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1658530013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8de23c4-6c3e-44e5-8277-10eaeb2abf1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='155cad4fe8b141b2a6e9d2ca898ca96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:01:40Z,use_quota=True,user_id='c8fede472ee74683917ec0c25ba0f911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:01:40 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Creating volume e8de23c4-6c3e-44e5-8277-10eaeb2abf1d {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:01:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:40 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:40 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:40 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:01:40 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:01:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:40 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d 1073741824 Nov 04 19:01:40 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141ac10a-8062-41ec-85d2-61c44ad0e1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6d03f70-5d17-4f4b-a950-effc329c851f', 'volume_size': 1, 'snapshot_id': 'da00fcf4-8284-4947-ae03-7488c14a703f'}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb8e803-4558-48ea-b873-3342ec6ef755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:40 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Volume volume-f6d03f70-5d17-4f4b-a950-effc329c851f (f6d03f70-5d17-4f4b-a950-effc329c851f): created successfully Nov 04 19:01:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb8e803-4558-48ea-b873-3342ec6ef755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Flow 'volume_create_manager' (63ee3a16-d86c-4506-9e66-801e0e9a338e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:01:40 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-2578638b-088f-4572-9ef1-ab8e1d367bca tempest-TestStampPattern-1723885731 None] Created volume successfully. Nov 04 19:01:40 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d 1073741824" returned: 0 in 0.722s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:40 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d Nov 04 19:01:40 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:41 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d" returned: 0 in 0.424s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:41 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:01:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:41 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (578ea737-7d4a-47bd-af0f-93c04d546075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:41 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce79a8a-db26-4c13-87c5-37725040ae1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:41 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Volume volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d (e8de23c4-6c3e-44e5-8277-10eaeb2abf1d): created successfully Nov 04 19:01:41 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce79a8a-db26-4c13-87c5-37725040ae1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:41 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Flow 'volume_create_manager' (8a78b955-64f9-414f-8064-36530a9a97ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:01:41 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-741ba561-77f8-4c79-9345-cba244232c29 tempest-TestImageHashVerification-1556590666 None] Created volume successfully. Nov 04 19:01:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-522db168-f824-4994-b505-85a3dab815d3 tempest-TestImageHashVerification-1556590666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-522db168-f824-4994-b505-85a3dab815d3 tempest-TestImageHashVerification-1556590666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:44 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e406a2-ac43-4682-a043-743b8988f589]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-522db168-f824-4994-b505-85a3dab815d3 tempest-TestImageHashVerification-1556590666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:44 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d Nov 04 19:01:44 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:45 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-522db168-f824-4994-b505-85a3dab815d3 tempest-TestImageHashVerification-1556590666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d" returned: 0 in 0.725s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:45 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[872536a3-dc44-4ca8-80b2-59e36b8301a2]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-522db168-f824-4994-b505-85a3dab815d3 tempest-TestImageHashVerification-1556590666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:45 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:01:45 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d Nov 04 19:01:45 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Flow 'volume_create_manager' (ab453b3c-f15d-463c-a577-5423fec18da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:01:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dbeb0bd-8b40-4ac3-8f4a-ae81740492f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dbeb0bd-8b40-4ac3-8f4a-ae81740492f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-499137125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5959aa91-350b-4071-a901-13098658a8df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e7ee967d6ca427b8a06963ab0c7933b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:01:45Z,use_quota=True,user_id='e89e9dcde2b94f45b6c2f6e3b15d059b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a8d012-b510-437b-803c-7bda9b72dc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a8d012-b510-437b-803c-7bda9b72dc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b066a3e3-1486-4abd-a289-f753cd8dc692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:45 devstack cinder-volume[87119]: DEBUG cinder.image.glance [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Creating Keystone auth plugin from conf {{(pid=87119) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 19:01:46 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-522db168-f824-4994-b505-85a3dab815d3 tempest-TestImageHashVerification-1556590666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d" returned: 0 in 0.580s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-522db168-f824-4994-b505-85a3dab815d3 tempest-TestImageHashVerification-1556590666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d /opt/stack/data/cinder/conversion/e8de23c4-6c3e-44e5-8277-10eaeb2abf1d.temp_image.1277e922-0b10-4719-ac2e-3697a148a902qto5rt7t.img {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:46 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d /opt/stack/data/cinder/conversion/e8de23c4-6c3e-44e5-8277-10eaeb2abf1d.temp_image.1277e922-0b10-4719-ac2e-3697a148a902qto5rt7t.img Nov 04 19:01:46 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b066a3e3-1486-4abd-a289-f753cd8dc692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5959aa91-350b-4071-a901-13098658a8df', 'volume_name': 'volume-5959aa91-350b-4071-a901-13098658a8df', 'volume_size': 1, 'image_id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '184bff60e125442790f1bc12f0dfbe3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'created_at': datetime.datetime(2026, 11, 4, 17, 42, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92369797-a01e-417a-9dd0-2d4494d8e28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92369797-a01e-417a-9dd0-2d4494d8e28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47631a81-c40b-42dd-b811-f3b44a7a732c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:46 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Volume 5959aa91-350b-4071-a901-13098658a8df: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5959aa91-350b-4071-a901-13098658a8df', 'volume_size': 1, 'image_id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '184bff60e125442790f1bc12f0dfbe3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'created_at': datetime.datetime(2026, 11, 4, 17, 42, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 19:01:46 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Trying to clone 5959aa91-350b-4071-a901-13098658a8df from image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d at location (None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}]). {{(pid=87119) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 19:01:48 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_f8kryxp4devstack@QuobyteHD, size 20.69 MB, duration 1.04 sec {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 19:01:48 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Image download 20.69 MB at 19.85 MB/s Nov 04 19:01:48 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[517999b3-8ac6-48b9-a5bd-6dfe582d9d08]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_f8kryxp4devstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:48 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_f8kryxp4devstack@QuobyteHD Nov 04 19:01:48 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:49 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_f8kryxp4devstack@QuobyteHD" returned: 0 in 0.874s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:49 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Temporary image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d is fetched for user e89e9dcde2b94f45b6c2f6e3b15d059b. {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 19:01:49 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b606fbb-48e7-459d-8c76-142d64b70c70]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_f8kryxp4devstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:49 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_f8kryxp4devstack@QuobyteHD Nov 04 19:01:49 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:50 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:01:50 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Flow 'volume_create_manager' (4a56647f-b716-4246-bc6c-a223a8d311a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:01:50 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecae9f2b-72cf-49d8-a45f-5a11273fd8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:50 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_f8kryxp4devstack@QuobyteHD" returned: 0 in 1.230s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:50 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecae9f2b-72cf-49d8-a45f-5a11273fd8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1394286732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bdfb382-96fd-4197-93f0-cbbe56df7a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6012d06f3d9e44e5a6c488177c5cb5b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:01:50Z,use_quota=True,user_id='daf2e3992f9a4e92a6ffd9c31529d80e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:50 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ec846f4-560c-4124-bc49-34b09df3b359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:50 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ec846f4-560c-4124-bc49-34b09df3b359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:50 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1313c7b3-781a-47f4-aa29-0a7b6c365879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:50 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1313c7b3-781a-47f4-aa29-0a7b6c365879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bdfb382-96fd-4197-93f0-cbbe56df7a97', 'volume_name': 'volume-3bdfb382-96fd-4197-93f0-cbbe56df7a97', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:50 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32142642-a78d-4fa2-84f2-67cfb638f654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:50 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32142642-a78d-4fa2-84f2-67cfb638f654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:50 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (426de742-a473-4126-b029-0de561a505b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:50 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Volume 3bdfb382-96fd-4197-93f0-cbbe56df7a97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bdfb382-96fd-4197-93f0-cbbe56df7a97', 'volume_size': 1} Nov 04 19:01:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:56 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-522db168-f824-4994-b505-85a3dab815d3 tempest-TestImageHashVerification-1556590666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d /opt/stack/data/cinder/conversion/e8de23c4-6c3e-44e5-8277-10eaeb2abf1d.temp_image.1277e922-0b10-4719-ac2e-3697a148a902qto5rt7t.img" returned: 0 in 10.244s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:56 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[157ac4db-9c1b-49cb-8572-cc7b217a77fa]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-522db168-f824-4994-b505-85a3dab815d3 tempest-TestImageHashVerification-1556590666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:56 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d Nov 04 19:01:56 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:56 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-522db168-f824-4994-b505-85a3dab815d3 tempest-TestImageHashVerification-1556590666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d" returned: 0 in 0.568s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:56 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-522db168-f824-4994-b505-85a3dab815d3 tempest-TestImageHashVerification-1556590666 None] Image conversion details: src /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d, size 1024.00 MB, duration 10.24 sec, destination /opt/stack/data/cinder/conversion/e8de23c4-6c3e-44e5-8277-10eaeb2abf1d.temp_image.1277e922-0b10-4719-ac2e-3697a148a902qto5rt7t.img {{(pid=87119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:01:56 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-522db168-f824-4994-b505-85a3dab815d3 tempest-TestImageHashVerification-1556590666 None] Converted 1024.00 MB image at 99.95 MB/s Nov 04 19:01:56 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-522db168-f824-4994-b505-85a3dab815d3 tempest-TestImageHashVerification-1556590666 None] 1277e922-0b10-4719-ac2e-3697a148a902 was raw, no need to convert to raw {{(pid=87119) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 04 19:02:00 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:UPDATE=4,cinder:SELECT=7,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:02:06 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=9,cinder:UPDATE=9,cinder:INSERT=1 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:02:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-522db168-f824-4994-b505-85a3dab815d3 tempest-TestImageHashVerification-1556590666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.839s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:16 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-522db168-f824-4994-b505-85a3dab815d3 tempest-TestImageHashVerification-1556590666 None] Uploaded volume to glance image-id: 1277e922-0b10-4719-ac2e-3697a148a902. {{(pid=87119) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 04 19:02:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.882s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:16 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-499137125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5959aa91-350b-4071-a901-13098658a8df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e7ee967d6ca427b8a06963ab0c7933b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:01:45Z,use_quota=True,user_id='e89e9dcde2b94f45b6c2f6e3b15d059b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:02:16 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Creating volume 5959aa91-350b-4071-a901-13098658a8df {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:02:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:16 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:02:16 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:02:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:16 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:02:16 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:02:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5959aa91-350b-4071-a901-13098658a8df 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:16 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-522db168-f824-4994-b505-85a3dab815d3 tempest-TestImageHashVerification-1556590666 None] Copy volume to image completed successfully. Nov 04 19:02:16 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5959aa91-350b-4071-a901-13098658a8df 1073741824 Nov 04 19:02:16 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:16 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5959aa91-350b-4071-a901-13098658a8df 1073741824" returned: 0 in 0.458s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5959aa91-350b-4071-a901-13098658a8df {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:17 devstack sudo[102743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5959aa91-350b-4071-a901-13098658a8df Nov 04 19:02:17 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:17 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5959aa91-350b-4071-a901-13098658a8df" returned: 0 in 0.260s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:17 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:02:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.548s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:17 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1394286732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bdfb382-96fd-4197-93f0-cbbe56df7a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6012d06f3d9e44e5a6c488177c5cb5b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:01:50Z,use_quota=True,user_id='daf2e3992f9a4e92a6ffd9c31529d80e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:02:17 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Creating volume 3bdfb382-96fd-4197-93f0-cbbe56df7a97 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:02:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:17 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:02:17 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:02:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:17 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:02:17 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:02:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3bdfb382-96fd-4197-93f0-cbbe56df7a97 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:17 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3bdfb382-96fd-4197-93f0-cbbe56df7a97 1073741824 Nov 04 19:02:17 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:17 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Attempting download of 1353e8e0-d342-427e-a3b6-10b6f6b08d2d ((None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}])) to volume 5959aa91-350b-4071-a901-13098658a8df. {{(pid=87119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 19:02:17 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf0cbe6-d03a-4147-97f0-5517eaf72ac8]: (4, 'raw') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:02:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_4nov5qjc {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:17 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_4nov5qjc Nov 04 19:02:17 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:17 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c3d7515d-9c0d-4d15-a4df-42f5aa074fd9 tempest-TestImageHashVerification-1556590666 None] Acquiring lock "cinder-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:17 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c3d7515d-9c0d-4d15-a4df-42f5aa074fd9 tempest-TestImageHashVerification-1556590666 None] Lock "cinder-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:17 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:17 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c3d7515d-9c0d-4d15-a4df-42f5aa074fd9 tempest-TestImageHashVerification-1556590666 None] Acquiring lock "cinder-quobyte-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_4nov5qjc" returned: 0 in 0.493s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_4nov5qjc {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:17 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c3d7515d-9c0d-4d15-a4df-42f5aa074fd9 tempest-TestImageHashVerification-1556590666 None] Lock "cinder-quobyte-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d" acquired by "delete_volume" :: waited 0.032s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:17 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3bdfb382-96fd-4197-93f0-cbbe56df7a97 1073741824" returned: 0 in 0.673s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:17 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66e2045-ed9c-42f0-a42b-ca37380d6ae8]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:02:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c3d7515d-9c0d-4d15-a4df-42f5aa074fd9 tempest-TestImageHashVerification-1556590666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3bdfb382-96fd-4197-93f0-cbbe56df7a97 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:18 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_4nov5qjc Nov 04 19:02:18 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:18 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3bdfb382-96fd-4197-93f0-cbbe56df7a97 Nov 04 19:02:18 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:18 devstack sudo[102766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d Nov 04 19:02:18 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:18 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:18 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3bdfb382-96fd-4197-93f0-cbbe56df7a97" returned: 0 in 0.350s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (426de742-a473-4126-b029-0de561a505b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bdfb382-96fd-4197-93f0-cbbe56df7a97', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e441f8b1-6256-4f90-b5a1-5d9d3861e218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_4nov5qjc" returned: 1 in 0.489s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_4nov5qjc' failed. Not Retrying. {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5468097-07c3-4629-b915-212afe019ab7]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_f8kryxp4devstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:18 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Volume volume-3bdfb382-96fd-4197-93f0-cbbe56df7a97 (3bdfb382-96fd-4197-93f0-cbbe56df7a97): created successfully Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e441f8b1-6256-4f90-b5a1-5d9d3861e218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:18 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Flow 'volume_create_manager' (4a56647f-b716-4246-bc6c-a223a8d311a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c3d7515d-9c0d-4d15-a4df-42f5aa074fd9 tempest-TestImageHashVerification-1556590666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d" returned: 0 in 0.466s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c3d7515d-9c0d-4d15-a4df-42f5aa074fd9 tempest-TestImageHashVerification-1556590666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:18 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-3484942b-2b83-44a5-a90c-090b58ffc4dd tempest-VolumesServicesTestJSON-1495339108 None] Created volume successfully. Nov 04 19:02:18 devstack sudo[102787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d Nov 04 19:02:18 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-3a8dc0a2-947c-44c2-90af-d538fcc1ad44 req-35ce2045-495e-46bd-8400-eb5b2150efc3 tempest-TestStampPattern-1723885731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-3a8dc0a2-947c-44c2-90af-d538fcc1ad44 req-35ce2045-495e-46bd-8400-eb5b2150efc3 tempest-TestStampPattern-1723885731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-3a8dc0a2-947c-44c2-90af-d538fcc1ad44 req-35ce2045-495e-46bd-8400-eb5b2150efc3 tempest-TestStampPattern-1723885731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:18 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_f8kryxp4devstack@QuobyteHD Nov 04 19:02:18 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-3a8dc0a2-947c-44c2-90af-d538fcc1ad44 req-35ce2045-495e-46bd-8400-eb5b2150efc3 tempest-TestStampPattern-1723885731 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280', 'name': 'volume-f6d03f70-5d17-4f4b-a950-effc329c851f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1f04c86-1ff2-4b65-bcb9-f7bc32e9792d', 'enforce_multipath': True} {{(pid=87119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:02:18 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-3a8dc0a2-947c-44c2-90af-d538fcc1ad44 req-35ce2045-495e-46bd-8400-eb5b2150efc3 tempest-TestStampPattern-1723885731 None] attachment_update completed successfully. Nov 04 19:02:18 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c3d7515d-9c0d-4d15-a4df-42f5aa074fd9 tempest-TestImageHashVerification-1556590666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d" returned: 0 in 0.298s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c3d7515d-9c0d-4d15-a4df-42f5aa074fd9 tempest-TestImageHashVerification-1556590666 None] Lock "cinder-quobyte-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d" released by "delete_volume" :: held 0.825s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:18 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_f8kryxp4devstack@QuobyteHD" returned: 0 in 0.395s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] 1353e8e0-d342-427e-a3b6-10b6f6b08d2d was qcow2, converting to qcow2 {{(pid=87119) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_f8kryxp4devstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5959aa91-350b-4071-a901-13098658a8df {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:18 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_f8kryxp4devstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5959aa91-350b-4071-a901-13098658a8df Nov 04 19:02:18 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-c3d7515d-9c0d-4d15-a4df-42f5aa074fd9 tempest-TestImageHashVerification-1556590666 None] Created reservations ['1b137de5-1e78-4146-9eb0-86af0fd497a4', '0535b288-62eb-409f-af6f-2f38454b748b', '8bc296b9-e5e6-4167-907e-5fa3d7bcafc9', '5a73d514-a095-4394-a44b-d4e67cdf5a3e'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c3d7515d-9c0d-4d15-a4df-42f5aa074fd9 tempest-TestImageHashVerification-1556590666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c3d7515d-9c0d-4d15-a4df-42f5aa074fd9 tempest-TestImageHashVerification-1556590666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c3d7515d-9c0d-4d15-a4df-42f5aa074fd9 tempest-TestImageHashVerification-1556590666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c3d7515d-9c0d-4d15-a4df-42f5aa074fd9 tempest-TestImageHashVerification-1556590666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c3d7515d-9c0d-4d15-a4df-42f5aa074fd9 tempest-TestImageHashVerification-1556590666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c3d7515d-9c0d-4d15-a4df-42f5aa074fd9 tempest-TestImageHashVerification-1556590666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:19 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:02:19 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:19 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c3d7515d-9c0d-4d15-a4df-42f5aa074fd9 tempest-TestImageHashVerification-1556590666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.353s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:19 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-c3d7515d-9c0d-4d15-a4df-42f5aa074fd9 tempest-TestImageHashVerification-1556590666 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:02:19 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-c3d7515d-9c0d-4d15-a4df-42f5aa074fd9 tempest-TestImageHashVerification-1556590666 None] Deleted volume successfully. Nov 04 19:02:19 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c3d7515d-9c0d-4d15-a4df-42f5aa074fd9 tempest-TestImageHashVerification-1556590666 None] Lock "cinder-e8de23c4-6c3e-44e5-8277-10eaeb2abf1d-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:19 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-efaae7c3-3cfb-4afa-bd57-71feca892388 tempest-VolumesServicesTestJSON-1495339108 None] Acquiring lock "cinder-3bdfb382-96fd-4197-93f0-cbbe56df7a97-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:19 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-efaae7c3-3cfb-4afa-bd57-71feca892388 tempest-VolumesServicesTestJSON-1495339108 None] Lock "cinder-3bdfb382-96fd-4197-93f0-cbbe56df7a97-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:19 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-efaae7c3-3cfb-4afa-bd57-71feca892388 tempest-VolumesServicesTestJSON-1495339108 None] Acquiring lock "cinder-quobyte-3bdfb382-96fd-4197-93f0-cbbe56df7a97" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:19 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-efaae7c3-3cfb-4afa-bd57-71feca892388 tempest-VolumesServicesTestJSON-1495339108 None] Lock "cinder-quobyte-3bdfb382-96fd-4197-93f0-cbbe56df7a97" acquired by "delete_volume" :: waited 0.020s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:19 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffe3c04-cbe5-4e1f-a9b5-b4c1ea7e71f1]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:02:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-efaae7c3-3cfb-4afa-bd57-71feca892388 tempest-VolumesServicesTestJSON-1495339108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3bdfb382-96fd-4197-93f0-cbbe56df7a97 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:19 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3bdfb382-96fd-4197-93f0-cbbe56df7a97 Nov 04 19:02:19 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:20 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-efaae7c3-3cfb-4afa-bd57-71feca892388 tempest-VolumesServicesTestJSON-1495339108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3bdfb382-96fd-4197-93f0-cbbe56df7a97" returned: 0 in 0.450s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-efaae7c3-3cfb-4afa-bd57-71feca892388 tempest-VolumesServicesTestJSON-1495339108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3bdfb382-96fd-4197-93f0-cbbe56df7a97 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:20 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3bdfb382-96fd-4197-93f0-cbbe56df7a97 Nov 04 19:02:20 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:20 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-efaae7c3-3cfb-4afa-bd57-71feca892388 tempest-VolumesServicesTestJSON-1495339108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3bdfb382-96fd-4197-93f0-cbbe56df7a97" returned: 0 in 0.309s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:20 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-efaae7c3-3cfb-4afa-bd57-71feca892388 tempest-VolumesServicesTestJSON-1495339108 None] Lock "cinder-quobyte-3bdfb382-96fd-4197-93f0-cbbe56df7a97" released by "delete_volume" :: held 0.815s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:20 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-efaae7c3-3cfb-4afa-bd57-71feca892388 tempest-VolumesServicesTestJSON-1495339108 None] Created reservations ['506a73a9-5d2a-44f4-ace0-02f55ec9c24f', 'ae089463-18d0-41f4-b392-011970b027f7', 'd33a7f37-3a80-4f00-9466-8df9926e88da', '0f0fca0d-2a61-4cae-ac10-26e39324ae1f'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:02:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-efaae7c3-3cfb-4afa-bd57-71feca892388 tempest-VolumesServicesTestJSON-1495339108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-efaae7c3-3cfb-4afa-bd57-71feca892388 tempest-VolumesServicesTestJSON-1495339108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-efaae7c3-3cfb-4afa-bd57-71feca892388 tempest-VolumesServicesTestJSON-1495339108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:02:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-efaae7c3-3cfb-4afa-bd57-71feca892388 tempest-VolumesServicesTestJSON-1495339108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:02:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-efaae7c3-3cfb-4afa-bd57-71feca892388 tempest-VolumesServicesTestJSON-1495339108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-efaae7c3-3cfb-4afa-bd57-71feca892388 tempest-VolumesServicesTestJSON-1495339108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:20 devstack sudo[103234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:02:20 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:21 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-efaae7c3-3cfb-4afa-bd57-71feca892388 tempest-VolumesServicesTestJSON-1495339108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.397s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:21 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-efaae7c3-3cfb-4afa-bd57-71feca892388 tempest-VolumesServicesTestJSON-1495339108 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:02:21 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-efaae7c3-3cfb-4afa-bd57-71feca892388 tempest-VolumesServicesTestJSON-1495339108 None] Deleted volume successfully. Nov 04 19:02:21 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-efaae7c3-3cfb-4afa-bd57-71feca892388 tempest-VolumesServicesTestJSON-1495339108 None] Lock "cinder-3bdfb382-96fd-4197-93f0-cbbe56df7a97-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:21 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_f8kryxp4devstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5959aa91-350b-4071-a901-13098658a8df" returned: 0 in 2.695s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:21 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_f8kryxp4devstack@QuobyteHD, size 112.00 MB, duration 2.70 sec, destination /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5959aa91-350b-4071-a901-13098658a8df {{(pid=87119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:02:21 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Converted 112.00 MB image at 41.54 MB/s Nov 04 19:02:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5959aa91-350b-4071-a901-13098658a8df 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:21 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5959aa91-350b-4071-a901-13098658a8df 1G Nov 04 19:02:21 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:21 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5959aa91-350b-4071-a901-13098658a8df 1G" returned: 0 in 0.477s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:21 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Downloaded image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d ((None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}])) to volume 5959aa91-350b-4071-a901-13098658a8df successfully. {{(pid=87119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 19:02:22 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Temporary image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d for user e89e9dcde2b94f45b6c2f6e3b15d059b is deleted. {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 19:02:22 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Marking volume 5959aa91-350b-4071-a901-13098658a8df as bootable. {{(pid=87119) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 19:02:22 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Copying metadata from image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d to 5959aa91-350b-4071-a901-13098658a8df. {{(pid=87119) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 19:02:22 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Creating volume glance metadata for volume 5959aa91-350b-4071-a901-13098658a8df backed by image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87119) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 19:02:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47631a81-c40b-42dd-b811-f3b44a7a732c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5959aa91-350b-4071-a901-13098658a8df', 'volume_size': 1, 'image_id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '184bff60e125442790f1bc12f0dfbe3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'created_at': datetime.datetime(2026, 11, 4, 17, 42, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9db242b-df07-4b12-8c48-620b1ec12447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:22 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Volume volume-5959aa91-350b-4071-a901-13098658a8df (5959aa91-350b-4071-a901-13098658a8df): created successfully Nov 04 19:02:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9db242b-df07-4b12-8c48-620b1ec12447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Flow 'volume_create_manager' (ab453b3c-f15d-463c-a577-5423fec18da8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:02:22 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-7888461e-5274-4c63-b6a6-1d6a07f33a9d tempest-TestShelveInstance-569206585 None] Created volume successfully. Nov 04 19:02:22 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-3674912d-307a-45cc-ae0a-a18cb1e549d7 req-20dd3186-9e04-465a-8562-fd8c44bed606 tempest-TestStampPattern-1723885731 None] Terminate volume connection completed successfully. Nov 04 19:02:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-3674912d-307a-45cc-ae0a-a18cb1e549d7 req-20dd3186-9e04-465a-8562-fd8c44bed606 tempest-TestStampPattern-1723885731 None] Deleting attachment b1f04c86-1ff2-4b65-bcb9-f7bc32e9792d. {{(pid=87119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:02:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:02:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:02:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:02:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:25 devstack sudo[103306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:02:25 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:25 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.327s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:25 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:02:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager._thread_info {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:02:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread count: 28 {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:02:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread info: [<_MainThread(MainThread, started 130247852032128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:02:28 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-91ca95a2-5793-4e7b-a65d-c46c2b0260d9 tempest-TestStampPattern-1723885731 None] Acquiring lock "cinder-f6d03f70-5d17-4f4b-a950-effc329c851f-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:28 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-91ca95a2-5793-4e7b-a65d-c46c2b0260d9 tempest-TestStampPattern-1723885731 None] Lock "cinder-f6d03f70-5d17-4f4b-a950-effc329c851f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:28 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-91ca95a2-5793-4e7b-a65d-c46c2b0260d9 tempest-TestStampPattern-1723885731 None] Acquiring lock "cinder-quobyte-f6d03f70-5d17-4f4b-a950-effc329c851f" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:28 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-91ca95a2-5793-4e7b-a65d-c46c2b0260d9 tempest-TestStampPattern-1723885731 None] Lock "cinder-quobyte-f6d03f70-5d17-4f4b-a950-effc329c851f" acquired by "delete_volume" :: waited 0.027s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:28 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c1ffd8-6d18-4f63-a340-2ce6af9bb609]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:02:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-91ca95a2-5793-4e7b-a65d-c46c2b0260d9 tempest-TestStampPattern-1723885731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f6d03f70-5d17-4f4b-a950-effc329c851f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:28 devstack sudo[103317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f6d03f70-5d17-4f4b-a950-effc329c851f Nov 04 19:02:28 devstack sudo[103317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-6e297a92-1ce9-4951-bb0d-ce80e273db5e req-7e977201-f957-407f-bc0c-4aa1de80b116 tempest-TestShelveInstance-569206585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-6e297a92-1ce9-4951-bb0d-ce80e273db5e req-7e977201-f957-407f-bc0c-4aa1de80b116 tempest-TestShelveInstance-569206585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-6e297a92-1ce9-4951-bb0d-ce80e273db5e req-7e977201-f957-407f-bc0c-4aa1de80b116 tempest-TestShelveInstance-569206585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-6e297a92-1ce9-4951-bb0d-ce80e273db5e req-7e977201-f957-407f-bc0c-4aa1de80b116 tempest-TestShelveInstance-569206585 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280', 'name': 'volume-5959aa91-350b-4071-a901-13098658a8df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fec28c6c-c9e2-4525-9140-a5455df70d6e', 'enforce_multipath': True} {{(pid=87119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:02:29 devstack sudo[103317]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-91ca95a2-5793-4e7b-a65d-c46c2b0260d9 tempest-TestStampPattern-1723885731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f6d03f70-5d17-4f4b-a950-effc329c851f" returned: 0 in 0.528s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-91ca95a2-5793-4e7b-a65d-c46c2b0260d9 tempest-TestStampPattern-1723885731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f6d03f70-5d17-4f4b-a950-effc329c851f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:29 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f6d03f70-5d17-4f4b-a950-effc329c851f Nov 04 19:02:29 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:29 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-6e297a92-1ce9-4951-bb0d-ce80e273db5e req-7e977201-f957-407f-bc0c-4aa1de80b116 tempest-TestShelveInstance-569206585 None] attachment_update completed successfully. Nov 04 19:02:29 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-91ca95a2-5793-4e7b-a65d-c46c2b0260d9 tempest-TestStampPattern-1723885731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f6d03f70-5d17-4f4b-a950-effc329c851f" returned: 0 in 0.323s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:29 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-91ca95a2-5793-4e7b-a65d-c46c2b0260d9 tempest-TestStampPattern-1723885731 None] Lock "cinder-quobyte-f6d03f70-5d17-4f4b-a950-effc329c851f" released by "delete_volume" :: held 0.944s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:29 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-91ca95a2-5793-4e7b-a65d-c46c2b0260d9 tempest-TestStampPattern-1723885731 None] Created reservations ['f1ce5bfa-a54f-41fb-bcc0-6d5720e3e475', 'fb71baa0-7a7d-4e72-9c8b-7dfdd2e73a05', '85815e4a-cf77-468e-b09e-c21efec6013c', 'c1247d93-4b4a-4d0f-af21-fc886385a764'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:02:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-91ca95a2-5793-4e7b-a65d-c46c2b0260d9 tempest-TestStampPattern-1723885731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-91ca95a2-5793-4e7b-a65d-c46c2b0260d9 tempest-TestStampPattern-1723885731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-91ca95a2-5793-4e7b-a65d-c46c2b0260d9 tempest-TestStampPattern-1723885731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:02:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-91ca95a2-5793-4e7b-a65d-c46c2b0260d9 tempest-TestStampPattern-1723885731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:02:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-91ca95a2-5793-4e7b-a65d-c46c2b0260d9 tempest-TestStampPattern-1723885731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-91ca95a2-5793-4e7b-a65d-c46c2b0260d9 tempest-TestStampPattern-1723885731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:29 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:02:29 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:30 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-91ca95a2-5793-4e7b-a65d-c46c2b0260d9 tempest-TestStampPattern-1723885731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.323s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:30 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-91ca95a2-5793-4e7b-a65d-c46c2b0260d9 tempest-TestStampPattern-1723885731 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:02:30 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-91ca95a2-5793-4e7b-a65d-c46c2b0260d9 tempest-TestStampPattern-1723885731 None] Deleted volume successfully. Nov 04 19:02:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-91ca95a2-5793-4e7b-a65d-c46c2b0260d9 tempest-TestStampPattern-1723885731 None] Lock "cinder-f6d03f70-5d17-4f4b-a950-effc329c851f-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:31 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-69c15d4d-24e3-4964-80ec-4c932430183e tempest-TestStampPattern-1723885731 None] Acquiring lock "cinder-da00fcf4-8284-4947-ae03-7488c14a703f-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:31 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-69c15d4d-24e3-4964-80ec-4c932430183e tempest-TestStampPattern-1723885731 None] Lock "cinder-da00fcf4-8284-4947-ae03-7488c14a703f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:31 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-69c15d4d-24e3-4964-80ec-4c932430183e tempest-TestStampPattern-1723885731 None] Acquiring lock "cinder-quobyte-5d2fc119-fc82-4843-a306-ed7044e48df9" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:31 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-69c15d4d-24e3-4964-80ec-4c932430183e tempest-TestStampPattern-1723885731 None] Lock "cinder-quobyte-5d2fc119-fc82-4843-a306-ed7044e48df9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:31 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-69c15d4d-24e3-4964-80ec-4c932430183e tempest-TestStampPattern-1723885731 None] Acquiring lock "cinder-quobyte-da00fcf4-8284-4947-ae03-7488c14a703f" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:31 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-69c15d4d-24e3-4964-80ec-4c932430183e tempest-TestStampPattern-1723885731 None] Lock "cinder-quobyte-da00fcf4-8284-4947-ae03-7488c14a703f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-69c15d4d-24e3-4964-80ec-4c932430183e tempest-TestStampPattern-1723885731 None] Deleting offline snapshot da00fcf4-8284-4947-ae03-7488c14a703f of volume 5d2fc119-fc82-4843-a306-ed7044e48df9 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:02:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-69c15d4d-24e3-4964-80ec-4c932430183e tempest-TestStampPattern-1723885731 None] snapshot_file for this snap is: volume-5d2fc119-fc82-4843-a306-ed7044e48df9.da00fcf4-8284-4947-ae03-7488c14a703f {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:02:31 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b546b2d-90a5-4c96-b1f1-fed5ed01a30f]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:02:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-69c15d4d-24e3-4964-80ec-4c932430183e tempest-TestStampPattern-1723885731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.da00fcf4-8284-4947-ae03-7488c14a703f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:31 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.da00fcf4-8284-4947-ae03-7488c14a703f Nov 04 19:02:31 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:31 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-69c15d4d-24e3-4964-80ec-4c932430183e tempest-TestStampPattern-1723885731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.da00fcf4-8284-4947-ae03-7488c14a703f" returned: 0 in 0.464s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-69c15d4d-24e3-4964-80ec-4c932430183e tempest-TestStampPattern-1723885731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d2fc119-fc82-4843-a306-ed7044e48df9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:02:32 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b672950-bcc7-4031-b432-57d43b7bc933]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:02:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-69c15d4d-24e3-4964-80ec-4c932430183e tempest-TestStampPattern-1723885731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:32 devstack sudo[103346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9 Nov 04 19:02:32 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:33 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-69c15d4d-24e3-4964-80ec-4c932430183e tempest-TestStampPattern-1723885731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9" returned: 0 in 1.156s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-69c15d4d-24e3-4964-80ec-4c932430183e tempest-TestStampPattern-1723885731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.da00fcf4-8284-4947-ae03-7488c14a703f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:33 devstack sudo[103482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.da00fcf4-8284-4947-ae03-7488c14a703f Nov 04 19:02:33 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:33 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-69c15d4d-24e3-4964-80ec-4c932430183e tempest-TestStampPattern-1723885731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.da00fcf4-8284-4947-ae03-7488c14a703f" returned: 0 in 0.611s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-69c15d4d-24e3-4964-80ec-4c932430183e tempest-TestStampPattern-1723885731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.da00fcf4-8284-4947-ae03-7488c14a703f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:33 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.da00fcf4-8284-4947-ae03-7488c14a703f Nov 04 19:02:33 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:34 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-69c15d4d-24e3-4964-80ec-4c932430183e tempest-TestStampPattern-1723885731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9.da00fcf4-8284-4947-ae03-7488c14a703f" returned: 0 in 0.388s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:34 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-69c15d4d-24e3-4964-80ec-4c932430183e tempest-TestStampPattern-1723885731 None] Lock "cinder-quobyte-da00fcf4-8284-4947-ae03-7488c14a703f" released by "_delete_snapshot" :: held 2.788s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:34 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-69c15d4d-24e3-4964-80ec-4c932430183e tempest-TestStampPattern-1723885731 None] Lock "cinder-quobyte-5d2fc119-fc82-4843-a306-ed7044e48df9" released by "delete_snapshot" :: held 2.822s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:34 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-69c15d4d-24e3-4964-80ec-4c932430183e tempest-TestStampPattern-1723885731 None] Created reservations ['16fae24e-b568-41cf-b55a-14c7dbec61a6', '8ffb676e-d92d-4eb6-bd2c-81f8d96ee425', 'e9a79a1d-43d1-4183-a3d5-15ca6318ad84', '8dff72b1-c77a-4316-935b-eeaf24d7272f'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:02:34 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-69c15d4d-24e3-4964-80ec-4c932430183e tempest-TestStampPattern-1723885731 None] Delete snapshot completed successfully. Nov 04 19:02:34 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-69c15d4d-24e3-4964-80ec-4c932430183e tempest-TestStampPattern-1723885731 None] Lock "cinder-da00fcf4-8284-4947-ae03-7488c14a703f-delete_snapshot" released by "delete_snapshot" :: held 3.038s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b1465fc2-5f26-4cfe-a034-503cc21414d4 tempest-TestStampPattern-1723885731 None] Acquiring lock "cinder-5d2fc119-fc82-4843-a306-ed7044e48df9-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b1465fc2-5f26-4cfe-a034-503cc21414d4 tempest-TestStampPattern-1723885731 None] Lock "cinder-5d2fc119-fc82-4843-a306-ed7044e48df9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b1465fc2-5f26-4cfe-a034-503cc21414d4 tempest-TestStampPattern-1723885731 None] Acquiring lock "cinder-quobyte-5d2fc119-fc82-4843-a306-ed7044e48df9" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b1465fc2-5f26-4cfe-a034-503cc21414d4 tempest-TestStampPattern-1723885731 None] Lock "cinder-quobyte-5d2fc119-fc82-4843-a306-ed7044e48df9" acquired by "delete_volume" :: waited 0.041s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:40 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[200255de-ec1d-4015-bbf5-c7838bb3f9fe]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:02:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b1465fc2-5f26-4cfe-a034-503cc21414d4 tempest-TestStampPattern-1723885731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:41 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9 Nov 04 19:02:41 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:41 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b1465fc2-5f26-4cfe-a034-503cc21414d4 tempest-TestStampPattern-1723885731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9" returned: 0 in 0.652s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b1465fc2-5f26-4cfe-a034-503cc21414d4 tempest-TestStampPattern-1723885731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:41 devstack sudo[103878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9 Nov 04 19:02:41 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:42 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b1465fc2-5f26-4cfe-a034-503cc21414d4 tempest-TestStampPattern-1723885731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5d2fc119-fc82-4843-a306-ed7044e48df9" returned: 0 in 0.476s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b1465fc2-5f26-4cfe-a034-503cc21414d4 tempest-TestStampPattern-1723885731 None] Lock "cinder-quobyte-5d2fc119-fc82-4843-a306-ed7044e48df9" released by "delete_volume" :: held 1.250s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:42 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-b1465fc2-5f26-4cfe-a034-503cc21414d4 tempest-TestStampPattern-1723885731 None] Created reservations ['1a710a22-23da-4e84-8fea-68dc044b34e6', '36ebd87b-bd87-424b-bfa5-07633f75b056', '67e6d90c-faac-42b1-9c16-47281ecff93a', '5f90c38f-bc24-4094-b1b9-e6f635bcb56a'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:02:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b1465fc2-5f26-4cfe-a034-503cc21414d4 tempest-TestStampPattern-1723885731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b1465fc2-5f26-4cfe-a034-503cc21414d4 tempest-TestStampPattern-1723885731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:42 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-b1465fc2-5f26-4cfe-a034-503cc21414d4 tempest-TestStampPattern-1723885731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:02:42 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-b1465fc2-5f26-4cfe-a034-503cc21414d4 tempest-TestStampPattern-1723885731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:02:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b1465fc2-5f26-4cfe-a034-503cc21414d4 tempest-TestStampPattern-1723885731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b1465fc2-5f26-4cfe-a034-503cc21414d4 tempest-TestStampPattern-1723885731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:42 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:02:42 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:42 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b1465fc2-5f26-4cfe-a034-503cc21414d4 tempest-TestStampPattern-1723885731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.433s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:42 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-b1465fc2-5f26-4cfe-a034-503cc21414d4 tempest-TestStampPattern-1723885731 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:02:42 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-b1465fc2-5f26-4cfe-a034-503cc21414d4 tempest-TestStampPattern-1723885731 None] Deleted volume successfully. Nov 04 19:02:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b1465fc2-5f26-4cfe-a034-503cc21414d4 tempest-TestStampPattern-1723885731 None] Lock "cinder-5d2fc119-fc82-4843-a306-ed7044e48df9-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:46 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:02:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Flow 'volume_create_manager' (6a002e43-f343-4e5c-9796-85c52d6383f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:02:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dbd54a4-97dc-4cd5-9da4-da1a23567b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dbd54a4-97dc-4cd5-9da4-da1a23567b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c08cad-c2da-42c7-9b9a-ac423e1cbae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fc62bc71f444f66bc4dbf9b31c9a44e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:02:47Z,use_quota=True,user_id='86579fb3132d469ba790fe3727a7133d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ef4dc7b-16a9-43af-a0f0-5be32fc50fd9),volume_type_id=8ef4dc7b-16a9-43af-a0f0-5be32fc50fd9)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77b87b6a-ff87-41c3-874f-53eed6194fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77b87b6a-ff87-41c3-874f-53eed6194fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de69e33-700d-4453-9199-f5891a5f89e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:46 devstack cinder-volume[87119]: DEBUG cinder.image.glance [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Creating Keystone auth plugin from conf {{(pid=87119) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 19:02:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de69e33-700d-4453-9199-f5891a5f89e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '35c08cad-c2da-42c7-9b9a-ac423e1cbae6', 'volume_name': 'volume-35c08cad-c2da-42c7-9b9a-ac423e1cbae6', 'volume_size': 1, 'image_id': 'b9a54ec6-3fc5-40d5-9f9a-4673fc903418', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9a54ec6-3fc5-40d5-9f9a-4673fc903418', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f8748d0befbf5cfd5e24f23d22ac3b3f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1fc62bc71f444f66bc4dbf9b31c9a44e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '13f7bc2bc504d2c9334b5cdad1dc0073c8d7ae7fbfeba0cd4d3f8327ca1df981a4cff61fb185cd445994cf45dc8dac78893bf4183a6c752d94bb1670f43064be', 'id': 'b9a54ec6-3fc5-40d5-9f9a-4673fc903418', 'created_at': datetime.datetime(2026, 11, 4, 18, 2, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 2, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9a54ec6-3fc5-40d5-9f9a-4673fc903418/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad1875f-380f-4019-8cec-a1d06bfa899a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad1875f-380f-4019-8cec-a1d06bfa899a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7795b37-9596-46b5-aaba-534fae39a10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:47 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Volume 35c08cad-c2da-42c7-9b9a-ac423e1cbae6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-35c08cad-c2da-42c7-9b9a-ac423e1cbae6', 'volume_size': 1, 'image_id': 'b9a54ec6-3fc5-40d5-9f9a-4673fc903418', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9a54ec6-3fc5-40d5-9f9a-4673fc903418', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f8748d0befbf5cfd5e24f23d22ac3b3f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1fc62bc71f444f66bc4dbf9b31c9a44e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '13f7bc2bc504d2c9334b5cdad1dc0073c8d7ae7fbfeba0cd4d3f8327ca1df981a4cff61fb185cd445994cf45dc8dac78893bf4183a6c752d94bb1670f43064be', 'id': 'b9a54ec6-3fc5-40d5-9f9a-4673fc903418', 'created_at': datetime.datetime(2026, 11, 4, 18, 2, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 2, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9a54ec6-3fc5-40d5-9f9a-4673fc903418/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 04 19:02:47 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Trying to clone 35c08cad-c2da-42c7-9b9a-ac423e1cbae6 from image b9a54ec6-3fc5-40d5-9f9a-4673fc903418 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b9a54ec6-3fc5-40d5-9f9a-4673fc903418', 'metadata': {}}]). {{(pid=87119) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 19:02:47 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_2is_xjcmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 19:02:47 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Image download 0.00 MB at 0.00 MB/s Nov 04 19:02:47 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[2193654d-b800-4f05-910b-93f8f4d0c04a]: (4, 'raw') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:02:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_2is_xjcmdevstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:47 devstack sudo[103888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_2is_xjcmdevstack@QuobyteHD Nov 04 19:02:47 devstack sudo[103888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:48 devstack sudo[103888]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_2is_xjcmdevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_2is_xjcmdevstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:48 devstack sudo[103892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_2is_xjcmdevstack@QuobyteHD Nov 04 19:02:48 devstack sudo[103892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:48 devstack sudo[103892]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_2is_xjcmdevstack@QuobyteHD" returned: 1 in 0.387s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_2is_xjcmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:02:48 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Temporary image b9a54ec6-3fc5-40d5-9f9a-4673fc903418 is fetched for user 86579fb3132d469ba790fe3727a7133d. {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 19:02:48 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1292d6-8866-4fb6-b38b-aac652dd1ec3]: (4, 'raw') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:02:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_2is_xjcmdevstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:48 devstack sudo[103897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_2is_xjcmdevstack@QuobyteHD Nov 04 19:02:48 devstack sudo[103897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:49 devstack sudo[103897]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_2is_xjcmdevstack@QuobyteHD" returned: 0 in 0.472s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_2is_xjcmdevstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:49 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_2is_xjcmdevstack@QuobyteHD Nov 04 19:02:49 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:49 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_2is_xjcmdevstack@QuobyteHD" returned: 1 in 0.572s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_2is_xjcmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:02:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:49 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c08cad-c2da-42c7-9b9a-ac423e1cbae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fc62bc71f444f66bc4dbf9b31c9a44e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:02:47Z,use_quota=True,user_id='86579fb3132d469ba790fe3727a7133d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ef4dc7b-16a9-43af-a0f0-5be32fc50fd9),volume_type_id=8ef4dc7b-16a9-43af-a0f0-5be32fc50fd9)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:02:49 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Creating volume 35c08cad-c2da-42c7-9b9a-ac423e1cbae6 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:02:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:49 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:02:49 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:02:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:49 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:02:49 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:02:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-35c08cad-c2da-42c7-9b9a-ac423e1cbae6 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:49 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-35c08cad-c2da-42c7-9b9a-ac423e1cbae6 1073741824 Nov 04 19:02:49 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:50 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-35c08cad-c2da-42c7-9b9a-ac423e1cbae6 1073741824" returned: 0 in 0.648s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-35c08cad-c2da-42c7-9b9a-ac423e1cbae6 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:50 devstack sudo[103913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-35c08cad-c2da-42c7-9b9a-ac423e1cbae6 Nov 04 19:02:50 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:50 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-35c08cad-c2da-42c7-9b9a-ac423e1cbae6" returned: 0 in 0.302s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:50 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:02:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:50 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Attempting download of b9a54ec6-3fc5-40d5-9f9a-4673fc903418 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9a54ec6-3fc5-40d5-9f9a-4673fc903418', 'metadata': {}}])) to volume 35c08cad-c2da-42c7-9b9a-ac423e1cbae6. {{(pid=87119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 19:02:50 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[724b6bb1-51dc-4b96-8a6e-e6af27f18afa]: (4, 'raw') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:02:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_ob14z9cl {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:50 devstack sudo[103916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_ob14z9cl Nov 04 19:02:50 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:51 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_ob14z9cl" returned: 0 in 0.472s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_ob14z9cl {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:51 devstack sudo[103920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_ob14z9cl Nov 04 19:02:51 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:51 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_ob14z9cl" returned: 1 in 0.402s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_ob14z9cl' failed. Not Retrying. {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:02:51 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[03714086-13c7-46e1-bbfa-49c18b1f5bbd]: (4, 'raw') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:02:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_2is_xjcmdevstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:51 devstack sudo[103924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_2is_xjcmdevstack@QuobyteHD Nov 04 19:02:51 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:52 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_2is_xjcmdevstack@QuobyteHD" returned: 0 in 0.508s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_2is_xjcmdevstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:52 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_2is_xjcmdevstack@QuobyteHD Nov 04 19:02:52 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:52 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_2is_xjcmdevstack@QuobyteHD" returned: 1 in 0.478s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_2is_xjcmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:02:52 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] b9a54ec6-3fc5-40d5-9f9a-4673fc903418 was raw, converting to qcow2 {{(pid=87119) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 19:02:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_2is_xjcmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-35c08cad-c2da-42c7-9b9a-ac423e1cbae6 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:52 devstack sudo[103994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_2is_xjcmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-35c08cad-c2da-42c7-9b9a-ac423e1cbae6 Nov 04 19:02:52 devstack sudo[103994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:53 devstack sudo[103994]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_2is_xjcmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-35c08cad-c2da-42c7-9b9a-ac423e1cbae6" returned: 0 in 0.720s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:53 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b9a54ec6-3fc5-40d5-9f9a-4673fc903418_2is_xjcmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-35c08cad-c2da-42c7-9b9a-ac423e1cbae6 {{(pid=87119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:02:53 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Converted 0.00 MB image at 0.00 MB/s Nov 04 19:02:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-35c08cad-c2da-42c7-9b9a-ac423e1cbae6 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:53 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-35c08cad-c2da-42c7-9b9a-ac423e1cbae6 1G Nov 04 19:02:53 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:53 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-35c08cad-c2da-42c7-9b9a-ac423e1cbae6 1G" returned: 0 in 0.416s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:53 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Downloaded image b9a54ec6-3fc5-40d5-9f9a-4673fc903418 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9a54ec6-3fc5-40d5-9f9a-4673fc903418', 'metadata': {}}])) to volume 35c08cad-c2da-42c7-9b9a-ac423e1cbae6 successfully. {{(pid=87119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 19:02:53 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Temporary image b9a54ec6-3fc5-40d5-9f9a-4673fc903418 for user 86579fb3132d469ba790fe3727a7133d is deleted. {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 19:02:53 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Marking volume 35c08cad-c2da-42c7-9b9a-ac423e1cbae6 as bootable. {{(pid=87119) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 19:02:53 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Copying metadata from image b9a54ec6-3fc5-40d5-9f9a-4673fc903418 to 35c08cad-c2da-42c7-9b9a-ac423e1cbae6. {{(pid=87119) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 19:02:53 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Creating volume glance metadata for volume 35c08cad-c2da-42c7-9b9a-ac423e1cbae6 backed by image b9a54ec6-3fc5-40d5-9f9a-4673fc903418 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b9a54ec6-3fc5-40d5-9f9a-4673fc903418', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f8748d0befbf5cfd5e24f23d22ac3b3f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87119) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 19:02:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7795b37-9596-46b5-aaba-534fae39a10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35c08cad-c2da-42c7-9b9a-ac423e1cbae6', 'volume_size': 1, 'image_id': 'b9a54ec6-3fc5-40d5-9f9a-4673fc903418', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9a54ec6-3fc5-40d5-9f9a-4673fc903418', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f8748d0befbf5cfd5e24f23d22ac3b3f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1fc62bc71f444f66bc4dbf9b31c9a44e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '13f7bc2bc504d2c9334b5cdad1dc0073c8d7ae7fbfeba0cd4d3f8327ca1df981a4cff61fb185cd445994cf45dc8dac78893bf4183a6c752d94bb1670f43064be', 'id': 'b9a54ec6-3fc5-40d5-9f9a-4673fc903418', 'created_at': datetime.datetime(2026, 11, 4, 18, 2, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 2, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9a54ec6-3fc5-40d5-9f9a-4673fc903418/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a030d8d-80dc-4c15-abe6-38727e7a2e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:54 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Volume volume-35c08cad-c2da-42c7-9b9a-ac423e1cbae6 (35c08cad-c2da-42c7-9b9a-ac423e1cbae6): created successfully Nov 04 19:02:54 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a030d8d-80dc-4c15-abe6-38727e7a2e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:54 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Flow 'volume_create_manager' (6a002e43-f343-4e5c-9796-85c52d6383f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:02:54 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-82ea5922-958f-4907-9888-ad40e63e03da tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Created volume successfully. Nov 04 19:02:54 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9b658410-0972-47e4-8196-365e6b08fb12 tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Acquiring lock "cinder-35c08cad-c2da-42c7-9b9a-ac423e1cbae6-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:54 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9b658410-0972-47e4-8196-365e6b08fb12 tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Lock "cinder-35c08cad-c2da-42c7-9b9a-ac423e1cbae6-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:54 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9b658410-0972-47e4-8196-365e6b08fb12 tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Acquiring lock "cinder-quobyte-35c08cad-c2da-42c7-9b9a-ac423e1cbae6" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:54 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9b658410-0972-47e4-8196-365e6b08fb12 tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Lock "cinder-quobyte-35c08cad-c2da-42c7-9b9a-ac423e1cbae6" acquired by "delete_volume" :: waited 0.027s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:54 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[293096d7-1f56-41cc-bea9-15af0b1dce13]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:02:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9b658410-0972-47e4-8196-365e6b08fb12 tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-35c08cad-c2da-42c7-9b9a-ac423e1cbae6 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:54 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-35c08cad-c2da-42c7-9b9a-ac423e1cbae6 Nov 04 19:02:54 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:55 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9b658410-0972-47e4-8196-365e6b08fb12 tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-35c08cad-c2da-42c7-9b9a-ac423e1cbae6" returned: 0 in 0.401s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9b658410-0972-47e4-8196-365e6b08fb12 tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-35c08cad-c2da-42c7-9b9a-ac423e1cbae6 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:55 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-35c08cad-c2da-42c7-9b9a-ac423e1cbae6 Nov 04 19:02:55 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:55 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9b658410-0972-47e4-8196-365e6b08fb12 tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-35c08cad-c2da-42c7-9b9a-ac423e1cbae6" returned: 0 in 0.279s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:55 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9b658410-0972-47e4-8196-365e6b08fb12 tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Lock "cinder-quobyte-35c08cad-c2da-42c7-9b9a-ac423e1cbae6" released by "delete_volume" :: held 0.743s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:55 devstack cinder-volume[87119]: WARNING cinder.quota [None req-9b658410-0972-47e4-8196-365e6b08fb12 tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:02:55 devstack cinder-volume[87119]: WARNING cinder.quota [None req-9b658410-0972-47e4-8196-365e6b08fb12 tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:02:55 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-9b658410-0972-47e4-8196-365e6b08fb12 tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Created reservations ['99e8bae4-7ad4-4212-b248-58c9dc682a56', '4065c826-57d1-4a17-8c29-6df1c2f64da1', '556ef110-11ad-4a4c-be06-f86e24ff5197', '35b44caf-0b0d-45f5-be49-be2d4269e97e'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:02:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9b658410-0972-47e4-8196-365e6b08fb12 tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9b658410-0972-47e4-8196-365e6b08fb12 tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:55 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9b658410-0972-47e4-8196-365e6b08fb12 tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:02:55 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9b658410-0972-47e4-8196-365e6b08fb12 tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:02:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9b658410-0972-47e4-8196-365e6b08fb12 tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9b658410-0972-47e4-8196-365e6b08fb12 tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:55 devstack sudo[104031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:02:55 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:55 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9b658410-0972-47e4-8196-365e6b08fb12 tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.384s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:55 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-9b658410-0972-47e4-8196-365e6b08fb12 tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:02:55 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-9b658410-0972-47e4-8196-365e6b08fb12 tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Deleted volume successfully. Nov 04 19:02:55 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9b658410-0972-47e4-8196-365e6b08fb12 tempest-VolumeAndVolumeTypeFromImageTest-315743672 None] Lock "cinder-35c08cad-c2da-42c7-9b9a-ac423e1cbae6-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:56 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:02:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Flow 'volume_create_manager' (edbfa816-00b8-4792-96b2-7d9dc42b6e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:02:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecea442c-0b20-42eb-90c2-ef427bce18f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecea442c-0b20-42eb-90c2-ef427bce18f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1037541290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caae4b53-8cc4-43a0-81e2-31b7e2e4924a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827a8c36625a4983a2f0db42660b2e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:02:56Z,use_quota=True,user_id='e57d74c6dea34381858f480897981984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca200bfa-e6ed-4926-b74d-26bf4587e10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca200bfa-e6ed-4926-b74d-26bf4587e10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5b8ab19-2f56-407d-83d8-f0c3fd27dd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:56 devstack cinder-volume[87119]: DEBUG cinder.image.glance [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Creating Keystone auth plugin from conf {{(pid=87119) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 19:02:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5b8ab19-2f56-407d-83d8-f0c3fd27dd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'caae4b53-8cc4-43a0-81e2-31b7e2e4924a', 'volume_name': 'volume-caae4b53-8cc4-43a0-81e2-31b7e2e4924a', 'volume_size': 1, 'image_id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '184bff60e125442790f1bc12f0dfbe3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'created_at': datetime.datetime(2026, 11, 4, 17, 42, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33fef001-e6ee-4710-98b6-b007a2e0f599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33fef001-e6ee-4710-98b6-b007a2e0f599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd963ef7-e38a-4197-ab40-f55b3479cd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:56 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Volume caae4b53-8cc4-43a0-81e2-31b7e2e4924a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-caae4b53-8cc4-43a0-81e2-31b7e2e4924a', 'volume_size': 1, 'image_id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '184bff60e125442790f1bc12f0dfbe3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'created_at': datetime.datetime(2026, 11, 4, 17, 42, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 19:02:56 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Trying to clone caae4b53-8cc4-43a0-81e2-31b7e2e4924a from image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d at location (None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}]). {{(pid=87119) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 19:02:56 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_q1c862ksdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 19:02:56 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Image download 20.69 MB at 20.69 MB/s Nov 04 19:02:57 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de070e1-6e18-4125-b8cd-e42f301216a4]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:02:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_q1c862ksdevstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:57 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_q1c862ksdevstack@QuobyteHD Nov 04 19:02:57 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:57 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_q1c862ksdevstack@QuobyteHD" returned: 0 in 0.452s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:57 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Temporary image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d is fetched for user e57d74c6dea34381858f480897981984. {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 19:02:57 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[154e78d4-b040-40a0-aafb-ed5dd482fbc7]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:02:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_q1c862ksdevstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:57 devstack sudo[104043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_q1c862ksdevstack@QuobyteHD Nov 04 19:02:57 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:57 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_q1c862ksdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1037541290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caae4b53-8cc4-43a0-81e2-31b7e2e4924a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827a8c36625a4983a2f0db42660b2e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:02:56Z,use_quota=True,user_id='e57d74c6dea34381858f480897981984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:02:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Creating volume caae4b53-8cc4-43a0-81e2-31b7e2e4924a {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:02:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:02:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:02:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:02:57 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:02:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-caae4b53-8cc4-43a0-81e2-31b7e2e4924a 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:58 devstack sudo[104048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-caae4b53-8cc4-43a0-81e2-31b7e2e4924a 1073741824 Nov 04 19:02:58 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:58 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-caae4b53-8cc4-43a0-81e2-31b7e2e4924a 1073741824" returned: 0 in 0.517s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-caae4b53-8cc4-43a0-81e2-31b7e2e4924a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:58 devstack sudo[104056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-caae4b53-8cc4-43a0-81e2-31b7e2e4924a Nov 04 19:02:58 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:58 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-caae4b53-8cc4-43a0-81e2-31b7e2e4924a" returned: 0 in 0.308s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:58 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:02:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:58 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Attempting download of 1353e8e0-d342-427e-a3b6-10b6f6b08d2d ((None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}])) to volume caae4b53-8cc4-43a0-81e2-31b7e2e4924a. {{(pid=87119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 19:02:58 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[030b6699-f966-4311-9d1a-6f0c9ebe671e]: (4, 'raw') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:02:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_hyqvx0ol {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:59 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_hyqvx0ol Nov 04 19:02:59 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:59 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_hyqvx0ol" returned: 0 in 0.416s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_hyqvx0ol {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:59 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_hyqvx0ol Nov 04 19:02:59 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:59 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_hyqvx0ol" returned: 1 in 0.350s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_hyqvx0ol' failed. Not Retrying. {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:02:59 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef5bd24-32c6-41e1-b6db-58b5f1ae9f81]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:02:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_q1c862ksdevstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:59 devstack sudo[104067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_q1c862ksdevstack@QuobyteHD Nov 04 19:02:59 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:00 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_q1c862ksdevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:00 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] 1353e8e0-d342-427e-a3b6-10b6f6b08d2d was qcow2, converting to qcow2 {{(pid=87119) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 19:03:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_q1c862ksdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-caae4b53-8cc4-43a0-81e2-31b7e2e4924a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:00 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_q1c862ksdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-caae4b53-8cc4-43a0-81e2-31b7e2e4924a Nov 04 19:03:00 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Flow 'volume_create_manager' (66e5e41b-1255-4a44-b78f-8c71cd7870b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b9cf65-16cb-477f-a1fa-2099cd1b6026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b9cf65-16cb-477f-a1fa-2099cd1b6026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-55357295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d99430f-d9ff-4bfa-bf77-c42d190af90f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a9bc0f00b5049029e32b96206ed1008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:02Z,use_quota=True,user_id='565f7568695945b7bdaae9033dbadd08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9861243b-dd36-45ca-8b2e-fc7b34d14e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9861243b-dd36-45ca-8b2e-fc7b34d14e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e11480-00ba-419a-a350-cdd4252775a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e11480-00ba-419a-a350-cdd4252775a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d99430f-d9ff-4bfa-bf77-c42d190af90f', 'volume_name': 'volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8304f951-02c6-46fd-999c-37501f093cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8304f951-02c6-46fd-999c-37501f093cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (931d2836-3eae-4b95-ad10-aa0ae69f7093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:02 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Volume 1d99430f-d9ff-4bfa-bf77-c42d190af90f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f', 'volume_size': 1} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-55357295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d99430f-d9ff-4bfa-bf77-c42d190af90f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a9bc0f00b5049029e32b96206ed1008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:02Z,use_quota=True,user_id='565f7568695945b7bdaae9033dbadd08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Creating volume 1d99430f-d9ff-4bfa-bf77-c42d190af90f {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:02 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:02 devstack sudo[104082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f 1073741824 Nov 04 19:03:02 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Flow 'volume_create_manager' (72bb80ff-67b2-445d-b7a2-6c6390bc8d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d184e42d-da2c-419a-90e1-84d25cabe8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:02 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_q1c862ksdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-caae4b53-8cc4-43a0-81e2-31b7e2e4924a" returned: 0 in 2.685s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_q1c862ksdevstack@QuobyteHD, size 112.00 MB, duration 2.69 sec, destination /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-caae4b53-8cc4-43a0-81e2-31b7e2e4924a {{(pid=87119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:03:02 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Converted 112.00 MB image at 41.69 MB/s Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-caae4b53-8cc4-43a0-81e2-31b7e2e4924a 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d184e42d-da2c-419a-90e1-84d25cabe8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-229762973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3bc460d-5389-4fa8-8ef5-e9f2a490360f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9592d241d844ca9d204ec09f9a6a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:03Z,use_quota=True,user_id='1cfa6723f68347a78fb8fc05c0e71d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065e80de-5ce7-4090-8cda-56fbfe068b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065e80de-5ce7-4090-8cda-56fbfe068b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:02 devstack sudo[104088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-caae4b53-8cc4-43a0-81e2-31b7e2e4924a 1G Nov 04 19:03:02 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e49621df-57be-41d1-bda6-4dd7c91fd626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e49621df-57be-41d1-bda6-4dd7c91fd626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3bc460d-5389-4fa8-8ef5-e9f2a490360f', 'volume_name': 'volume-e3bc460d-5389-4fa8-8ef5-e9f2a490360f', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239a208c-1723-4766-9824-bd1f8415dd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239a208c-1723-4766-9824-bd1f8415dd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed65206-0aec-42e6-ac18-1ce6017143ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:02 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Volume e3bc460d-5389-4fa8-8ef5-e9f2a490360f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3bc460d-5389-4fa8-8ef5-e9f2a490360f', 'volume_size': 1} Nov 04 19:03:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:03 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f 1073741824" returned: 0 in 0.725s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:03 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f Nov 04 19:03:03 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:03 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-caae4b53-8cc4-43a0-81e2-31b7e2e4924a 1G" returned: 0 in 0.394s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Downloaded image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d ((None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}])) to volume caae4b53-8cc4-43a0-81e2-31b7e2e4924a successfully. {{(pid=87119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Temporary image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d for user e57d74c6dea34381858f480897981984 is deleted. {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Marking volume caae4b53-8cc4-43a0-81e2-31b7e2e4924a as bootable. {{(pid=87119) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Copying metadata from image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d to caae4b53-8cc4-43a0-81e2-31b7e2e4924a. {{(pid=87119) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Creating volume glance metadata for volume caae4b53-8cc4-43a0-81e2-31b7e2e4924a backed by image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87119) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd963ef7-e38a-4197-ab40-f55b3479cd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caae4b53-8cc4-43a0-81e2-31b7e2e4924a', 'volume_size': 1, 'image_id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '184bff60e125442790f1bc12f0dfbe3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'created_at': datetime.datetime(2026, 11, 4, 17, 42, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b1ff3d2-42fb-474a-a727-b48cb975a56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:03 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Volume volume-caae4b53-8cc4-43a0-81e2-31b7e2e4924a (caae4b53-8cc4-43a0-81e2-31b7e2e4924a): created successfully Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b1ff3d2-42fb-474a-a727-b48cb975a56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Flow 'volume_create_manager' (edbfa816-00b8-4792-96b2-7d9dc42b6e28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:03 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-2c2e2cf4-0fa9-4b90-86bf-1dddc19028a9 tempest-VolumesImageMetadata-1712320140 None] Created volume successfully. Nov 04 19:03:03 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f" returned: 0 in 0.288s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.528s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-229762973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3bc460d-5389-4fa8-8ef5-e9f2a490360f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9592d241d844ca9d204ec09f9a6a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:03Z,use_quota=True,user_id='1cfa6723f68347a78fb8fc05c0e71d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Creating volume e3bc460d-5389-4fa8-8ef5-e9f2a490360f {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:03 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e3bc460d-5389-4fa8-8ef5-e9f2a490360f 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (931d2836-3eae-4b95-ad10-aa0ae69f7093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:03 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e3bc460d-5389-4fa8-8ef5-e9f2a490360f 1073741824 Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb2f46cc-2fac-42c6-9517-b9b1839ef0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:03 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:03 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Volume volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f (1d99430f-d9ff-4bfa-bf77-c42d190af90f): created successfully Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb2f46cc-2fac-42c6-9517-b9b1839ef0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Flow 'volume_create_manager' (66e5e41b-1255-4a44-b78f-8c71cd7870b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:03 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-c82c5b7d-a4bc-45f0-9370-82326aceb93a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Created volume successfully. Nov 04 19:03:04 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e3bc460d-5389-4fa8-8ef5-e9f2a490360f 1073741824" returned: 0 in 0.603s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e3bc460d-5389-4fa8-8ef5-e9f2a490360f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:04 devstack sudo[104110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e3bc460d-5389-4fa8-8ef5-e9f2a490360f Nov 04 19:03:04 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4bfca2cf-0757-4c94-960b-ad058bc75cac tempest-VolumesImageMetadata-1712320140 None] Acquiring lock "cinder-caae4b53-8cc4-43a0-81e2-31b7e2e4924a-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4bfca2cf-0757-4c94-960b-ad058bc75cac tempest-VolumesImageMetadata-1712320140 None] Lock "cinder-caae4b53-8cc4-43a0-81e2-31b7e2e4924a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4bfca2cf-0757-4c94-960b-ad058bc75cac tempest-VolumesImageMetadata-1712320140 None] Acquiring lock "cinder-quobyte-caae4b53-8cc4-43a0-81e2-31b7e2e4924a" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4bfca2cf-0757-4c94-960b-ad058bc75cac tempest-VolumesImageMetadata-1712320140 None] Lock "cinder-quobyte-caae4b53-8cc4-43a0-81e2-31b7e2e4924a" acquired by "delete_volume" :: waited 0.023s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:04 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3623dd-7ecd-4db4-809c-649acccbf897]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4bfca2cf-0757-4c94-960b-ad058bc75cac tempest-VolumesImageMetadata-1712320140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-caae4b53-8cc4-43a0-81e2-31b7e2e4924a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:04 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-caae4b53-8cc4-43a0-81e2-31b7e2e4924a Nov 04 19:03:04 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:04 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e3bc460d-5389-4fa8-8ef5-e9f2a490360f" returned: 0 in 0.462s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:04 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-de41f7fc-7bde-4f72-aac0-ed3bc0d72eb0 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-de41f7fc-7bde-4f72-aac0-ed3bc0d72eb0 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:04 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-de41f7fc-7bde-4f72-aac0-ed3bc0d72eb0 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Creating offline snapshot 54f31c52-9852-409f-a751-3a9a27d86848 of volume 1d99430f-d9ff-4bfa-bf77-c42d190af90f {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:03:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed65206-0aec-42e6-ac18-1ce6017143ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3bc460d-5389-4fa8-8ef5-e9f2a490360f', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa910c5-ecbe-4db8-a022-a26de1c275f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:04 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6a6da4-f642-4f32-9dcc-1d6d87e2821a]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-de41f7fc-7bde-4f72-aac0-ed3bc0d72eb0 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:04 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Volume volume-e3bc460d-5389-4fa8-8ef5-e9f2a490360f (e3bc460d-5389-4fa8-8ef5-e9f2a490360f): created successfully Nov 04 19:03:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa910c5-ecbe-4db8-a022-a26de1c275f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Flow 'volume_create_manager' (72bb80ff-67b2-445d-b7a2-6c6390bc8d22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:04 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-996a7b5f-a733-4f34-9fb6-be385c213a6d tempest-ProjectReaderTests-1890815915 None] Created volume successfully. Nov 04 19:03:04 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f Nov 04 19:03:04 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:04 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4bfca2cf-0757-4c94-960b-ad058bc75cac tempest-VolumesImageMetadata-1712320140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-caae4b53-8cc4-43a0-81e2-31b7e2e4924a" returned: 0 in 0.477s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4bfca2cf-0757-4c94-960b-ad058bc75cac tempest-VolumesImageMetadata-1712320140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-caae4b53-8cc4-43a0-81e2-31b7e2e4924a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:04 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-caae4b53-8cc4-43a0-81e2-31b7e2e4924a Nov 04 19:03:04 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7d0515b6-f8b6-41f8-bc48-fea60a86f255 tempest-ProjectReaderTests-1890815915 None] Acquiring lock "cinder-e3bc460d-5389-4fa8-8ef5-e9f2a490360f-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7d0515b6-f8b6-41f8-bc48-fea60a86f255 tempest-ProjectReaderTests-1890815915 None] Lock "cinder-e3bc460d-5389-4fa8-8ef5-e9f2a490360f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:05 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-de41f7fc-7bde-4f72-aac0-ed3bc0d72eb0 tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f" returned: 0 in 0.436s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-de41f7fc-7bde-4f72-aac0-ed3bc0d72eb0 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f.54f31c52-9852-409f-a751-3a9a27d86848 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:05 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f.54f31c52-9852-409f-a751-3a9a27d86848 1G Nov 04 19:03:05 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7d0515b6-f8b6-41f8-bc48-fea60a86f255 tempest-ProjectReaderTests-1890815915 None] Acquiring lock "cinder-quobyte-e3bc460d-5389-4fa8-8ef5-e9f2a490360f" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7d0515b6-f8b6-41f8-bc48-fea60a86f255 tempest-ProjectReaderTests-1890815915 None] Lock "cinder-quobyte-e3bc460d-5389-4fa8-8ef5-e9f2a490360f" acquired by "delete_volume" :: waited 0.022s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:05 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[61100478-8745-4508-8422-e179eb694427]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7d0515b6-f8b6-41f8-bc48-fea60a86f255 tempest-ProjectReaderTests-1890815915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e3bc460d-5389-4fa8-8ef5-e9f2a490360f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:05 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4bfca2cf-0757-4c94-960b-ad058bc75cac tempest-VolumesImageMetadata-1712320140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-caae4b53-8cc4-43a0-81e2-31b7e2e4924a" returned: 0 in 0.339s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4bfca2cf-0757-4c94-960b-ad058bc75cac tempest-VolumesImageMetadata-1712320140 None] Lock "cinder-quobyte-caae4b53-8cc4-43a0-81e2-31b7e2e4924a" released by "delete_volume" :: held 0.894s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:05 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e3bc460d-5389-4fa8-8ef5-e9f2a490360f Nov 04 19:03:05 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:05 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-4bfca2cf-0757-4c94-960b-ad058bc75cac tempest-VolumesImageMetadata-1712320140 None] Created reservations ['ea7aff3c-58a4-4e48-a46d-e85dc4ff2489', 'a8deb49c-6911-4942-95b1-8c625ba28a40', 'db28f226-aa49-4417-ac41-24f055a8e865', '4593a599-27ed-48da-846f-9ee7d054bd30'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4bfca2cf-0757-4c94-960b-ad058bc75cac tempest-VolumesImageMetadata-1712320140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4bfca2cf-0757-4c94-960b-ad058bc75cac tempest-VolumesImageMetadata-1712320140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4bfca2cf-0757-4c94-960b-ad058bc75cac tempest-VolumesImageMetadata-1712320140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4bfca2cf-0757-4c94-960b-ad058bc75cac tempest-VolumesImageMetadata-1712320140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4bfca2cf-0757-4c94-960b-ad058bc75cac tempest-VolumesImageMetadata-1712320140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4bfca2cf-0757-4c94-960b-ad058bc75cac tempest-VolumesImageMetadata-1712320140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:05 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:03:05 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:05 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7d0515b6-f8b6-41f8-bc48-fea60a86f255 tempest-ProjectReaderTests-1890815915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e3bc460d-5389-4fa8-8ef5-e9f2a490360f" returned: 0 in 0.460s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7d0515b6-f8b6-41f8-bc48-fea60a86f255 tempest-ProjectReaderTests-1890815915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e3bc460d-5389-4fa8-8ef5-e9f2a490360f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:05 devstack sudo[104144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e3bc460d-5389-4fa8-8ef5-e9f2a490360f Nov 04 19:03:05 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:05 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-de41f7fc-7bde-4f72-aac0-ed3bc0d72eb0 tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f.54f31c52-9852-409f-a751-3a9a27d86848 1G" returned: 0 in 0.600s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-de41f7fc-7bde-4f72-aac0-ed3bc0d72eb0 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f.54f31c52-9852-409f-a751-3a9a27d86848 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:05 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f.54f31c52-9852-409f-a751-3a9a27d86848 Nov 04 19:03:05 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:05 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4bfca2cf-0757-4c94-960b-ad058bc75cac tempest-VolumesImageMetadata-1712320140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.334s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:05 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-4bfca2cf-0757-4c94-960b-ad058bc75cac tempest-VolumesImageMetadata-1712320140 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:05 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-4bfca2cf-0757-4c94-960b-ad058bc75cac tempest-VolumesImageMetadata-1712320140 None] Deleted volume successfully. Nov 04 19:03:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4bfca2cf-0757-4c94-960b-ad058bc75cac tempest-VolumesImageMetadata-1712320140 None] Lock "cinder-caae4b53-8cc4-43a0-81e2-31b7e2e4924a-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:05 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7d0515b6-f8b6-41f8-bc48-fea60a86f255 tempest-ProjectReaderTests-1890815915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e3bc460d-5389-4fa8-8ef5-e9f2a490360f" returned: 0 in 0.356s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7d0515b6-f8b6-41f8-bc48-fea60a86f255 tempest-ProjectReaderTests-1890815915 None] Lock "cinder-quobyte-e3bc460d-5389-4fa8-8ef5-e9f2a490360f" released by "delete_volume" :: held 0.880s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:06 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-7d0515b6-f8b6-41f8-bc48-fea60a86f255 tempest-ProjectReaderTests-1890815915 None] Created reservations ['54ba046e-7f05-4778-a409-b52b155ab4a4', '1d541184-6772-43f5-8014-2ccea57262a3', '0d06333d-267b-46d7-95d8-efb55b24af38', 'af56b183-593c-4733-816d-a9a8a78438c4'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:06 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-de41f7fc-7bde-4f72-aac0-ed3bc0d72eb0 tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f.54f31c52-9852-409f-a751-3a9a27d86848" returned: 0 in 0.524s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:06 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-de41f7fc-7bde-4f72-aac0-ed3bc0d72eb0 tempest-CreateVolumesFromSnapshotTest-1280290233 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f.54f31c52-9852-409f-a751-3a9a27d86848 is being set with open permissions: ugo+rw Nov 04 19:03:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-de41f7fc-7bde-4f72-aac0-ed3bc0d72eb0 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f.54f31c52-9852-409f-a751-3a9a27d86848 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:06 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f.54f31c52-9852-409f-a751-3a9a27d86848 Nov 04 19:03:06 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7d0515b6-f8b6-41f8-bc48-fea60a86f255 tempest-ProjectReaderTests-1890815915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7d0515b6-f8b6-41f8-bc48-fea60a86f255 tempest-ProjectReaderTests-1890815915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:06 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7d0515b6-f8b6-41f8-bc48-fea60a86f255 tempest-ProjectReaderTests-1890815915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:06 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7d0515b6-f8b6-41f8-bc48-fea60a86f255 tempest-ProjectReaderTests-1890815915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7d0515b6-f8b6-41f8-bc48-fea60a86f255 tempest-ProjectReaderTests-1890815915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7d0515b6-f8b6-41f8-bc48-fea60a86f255 tempest-ProjectReaderTests-1890815915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:06 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:03:06 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:06 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-de41f7fc-7bde-4f72-aac0-ed3bc0d72eb0 tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f.54f31c52-9852-409f-a751-3a9a27d86848" returned: 0 in 0.486s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:06 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7d0515b6-f8b6-41f8-bc48-fea60a86f255 tempest-ProjectReaderTests-1890815915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.388s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:06 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-7d0515b6-f8b6-41f8-bc48-fea60a86f255 tempest-ProjectReaderTests-1890815915 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:06 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-7d0515b6-f8b6-41f8-bc48-fea60a86f255 tempest-ProjectReaderTests-1890815915 None] Deleted volume successfully. Nov 04 19:03:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-de41f7fc-7bde-4f72-aac0-ed3bc0d72eb0 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7d0515b6-f8b6-41f8-bc48-fea60a86f255 tempest-ProjectReaderTests-1890815915 None] Lock "cinder-e3bc460d-5389-4fa8-8ef5-e9f2a490360f-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:06 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f.info Nov 04 19:03:06 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:07 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-de41f7fc-7bde-4f72-aac0-ed3bc0d72eb0 tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f.info" returned: 0 in 0.326s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:07 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-de41f7fc-7bde-4f72-aac0-ed3bc0d72eb0 tempest-CreateVolumesFromSnapshotTest-1280290233 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f.info is being set with open permissions: ugo+rw Nov 04 19:03:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-de41f7fc-7bde-4f72-aac0-ed3bc0d72eb0 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:07 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f.info Nov 04 19:03:07 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:07 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-de41f7fc-7bde-4f72-aac0-ed3bc0d72eb0 tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f.info" returned: 0 in 0.307s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-de41f7fc-7bde-4f72-aac0-ed3bc0d72eb0 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.861s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:07 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=90,cinder:INSERT=37,cinder:UPDATE=86,cinder:DELETE=5 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:03:07 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-de41f7fc-7bde-4f72-aac0-ed3bc0d72eb0 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Create snapshot completed successfully Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Flow 'volume_create_manager' (793fc754-8cf3-4a34-a0b5-6c2f1ffb073e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a33df1-8747-420b-b724-66869fe02cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a33df1-8747-420b-b724-66869fe02cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-598732128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c95b7a-9f60-420f-b7ec-ab903cb1f1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9592d241d844ca9d204ec09f9a6a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:08Z,use_quota=True,user_id='1cfa6723f68347a78fb8fc05c0e71d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a081bb1c-d55a-4aec-9577-c47b74127277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a081bb1c-d55a-4aec-9577-c47b74127277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e8b096b-491b-4d95-b2cf-1029748de6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e8b096b-491b-4d95-b2cf-1029748de6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65c95b7a-9f60-420f-b7ec-ab903cb1f1e0', 'volume_name': 'volume-65c95b7a-9f60-420f-b7ec-ab903cb1f1e0', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1303967b-bfa3-4839-8448-42cc2b025b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1303967b-bfa3-4839-8448-42cc2b025b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f051255-a352-46b8-8aff-d17cc806996a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:08 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Volume 65c95b7a-9f60-420f-b7ec-ab903cb1f1e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65c95b7a-9f60-420f-b7ec-ab903cb1f1e0', 'volume_size': 1} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-598732128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c95b7a-9f60-420f-b7ec-ab903cb1f1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9592d241d844ca9d204ec09f9a6a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:08Z,use_quota=True,user_id='1cfa6723f68347a78fb8fc05c0e71d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Creating volume 65c95b7a-9f60-420f-b7ec-ab903cb1f1e0 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:08 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-65c95b7a-9f60-420f-b7ec-ab903cb1f1e0 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:08 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-65c95b7a-9f60-420f-b7ec-ab903cb1f1e0 1073741824 Nov 04 19:03:08 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Flow 'volume_create_manager' (2ad77dbd-01cd-4a58-b4e2-db8925f06bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce1e0c0-5757-4db3-802a-f70a1910f8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce1e0c0-5757-4db3-802a-f70a1910f8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1681935887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e58ddee-90ea-4517-b3ae-bb61d4923185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a9bc0f00b5049029e32b96206ed1008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:09Z,use_quota=True,user_id='565f7568695945b7bdaae9033dbadd08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1792e8-f7da-494b-9644-471d13926629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1792e8-f7da-494b-9644-471d13926629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a895d704-aa5b-403f-a6aa-ccab8e1ae10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a895d704-aa5b-403f-a6aa-ccab8e1ae10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e58ddee-90ea-4517-b3ae-bb61d4923185', 'volume_name': 'volume-9e58ddee-90ea-4517-b3ae-bb61d4923185', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e5a14da-8182-415c-aaad-0cf50075b021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e5a14da-8182-415c-aaad-0cf50075b021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a321bf8-0b09-4bc9-9080-6c0185f3111b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:08 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Volume 9e58ddee-90ea-4517-b3ae-bb61d4923185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e58ddee-90ea-4517-b3ae-bb61d4923185', 'volume_size': 1} Nov 04 19:03:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:09 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-65c95b7a-9f60-420f-b7ec-ab903cb1f1e0 1073741824" returned: 0 in 0.944s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-65c95b7a-9f60-420f-b7ec-ab903cb1f1e0 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:09 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-65c95b7a-9f60-420f-b7ec-ab903cb1f1e0 Nov 04 19:03:09 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Flow 'volume_create_manager' (9c9acfdd-a684-4133-b43e-1f7adbc40981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f13e22e-5b9d-4afb-9dbf-4355fb45afab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:09 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-f492b817-decd-401f-85bc-9bb2a4bbf216 req-0f76a033-3030-469e-b9c0-67c91a8194ca tempest-TestShelveInstance-569206585 None] Terminate volume connection completed successfully. Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-f492b817-decd-401f-85bc-9bb2a4bbf216 req-0f76a033-3030-469e-b9c0-67c91a8194ca tempest-TestShelveInstance-569206585 None] Deleting attachment fec28c6c-c9e2-4525-9140-a5455df70d6e. {{(pid=87119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f13e22e-5b9d-4afb-9dbf-4355fb45afab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1224036772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0d34d66-eaef-4a82-81ba-8e9a0bf05f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a9bc0f00b5049029e32b96206ed1008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:09Z,use_quota=True,user_id='565f7568695945b7bdaae9033dbadd08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45015a36-23ea-4f3d-acfb-faa71548daee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45015a36-23ea-4f3d-acfb-faa71548daee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3e534b-b079-4299-b3df-31e195760888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3e534b-b079-4299-b3df-31e195760888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0d34d66-eaef-4a82-81ba-8e9a0bf05f1b', 'volume_name': 'volume-c0d34d66-eaef-4a82-81ba-8e9a0bf05f1b', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213319f1-f48e-4543-af2e-d297d05dde94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213319f1-f48e-4543-af2e-d297d05dde94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718e0ce8-da53-4287-82b2-52bb31ad1260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:09 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Volume c0d34d66-eaef-4a82-81ba-8e9a0bf05f1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0d34d66-eaef-4a82-81ba-8e9a0bf05f1b', 'volume_size': 1} Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:09 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-65c95b7a-9f60-420f-b7ec-ab903cb1f1e0" returned: 0 in 0.493s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.784s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1681935887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e58ddee-90ea-4517-b3ae-bb61d4923185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a9bc0f00b5049029e32b96206ed1008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:09Z,use_quota=True,user_id='565f7568695945b7bdaae9033dbadd08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Creating volume 9e58ddee-90ea-4517-b3ae-bb61d4923185 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:09 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-9e58ddee-90ea-4517-b3ae-bb61d4923185 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f051255-a352-46b8-8aff-d17cc806996a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65c95b7a-9f60-420f-b7ec-ab903cb1f1e0', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f566d00-bb0d-44e5-816b-e1d0473b6da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:09 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-9e58ddee-90ea-4517-b3ae-bb61d4923185 1073741824 Nov 04 19:03:09 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:09 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Volume volume-65c95b7a-9f60-420f-b7ec-ab903cb1f1e0 (65c95b7a-9f60-420f-b7ec-ab903cb1f1e0): created successfully Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f566d00-bb0d-44e5-816b-e1d0473b6da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Flow 'volume_create_manager' (793fc754-8cf3-4a34-a0b5-6c2f1ffb073e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:09 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-16efbd85-ae33-4df4-9908-bfda13488595 tempest-ProjectReaderTests-1890815915 None] Created volume successfully. Nov 04 19:03:09 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Flow 'volume_create_manager' (b00637e7-0451-458d-9dec-6df0f9e93485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa8a0632-fc77-4247-85b6-eaae9978b322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa8a0632-fc77-4247-85b6-eaae9978b322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-114362538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e0338f-b2db-49a2-8a06-83f6f7a453c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a9bc0f00b5049029e32b96206ed1008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:10Z,use_quota=True,user_id='565f7568695945b7bdaae9033dbadd08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5ad80a-37a0-4c8c-a4ff-cc43c4357adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5ad80a-37a0-4c8c-a4ff-cc43c4357adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ada85c-a0a5-4da4-8dc4-7ac5acc057c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ada85c-a0a5-4da4-8dc4-7ac5acc057c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4e0338f-b2db-49a2-8a06-83f6f7a453c0', 'volume_name': 'volume-b4e0338f-b2db-49a2-8a06-83f6f7a453c0', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dc0c164-74e6-4947-9b47-1ba54a020685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dc0c164-74e6-4947-9b47-1ba54a020685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1908ea9a-bbb8-4fba-809e-5e7f821bf3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:10 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Volume b4e0338f-b2db-49a2-8a06-83f6f7a453c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4e0338f-b2db-49a2-8a06-83f6f7a453c0', 'volume_size': 1} Nov 04 19:03:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-17578f1d-a26f-42a1-bd62-9896c8185c78 tempest-ProjectReaderTests-1890815915 None] Acquiring lock "cinder-65c95b7a-9f60-420f-b7ec-ab903cb1f1e0-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-17578f1d-a26f-42a1-bd62-9896c8185c78 tempest-ProjectReaderTests-1890815915 None] Lock "cinder-65c95b7a-9f60-420f-b7ec-ab903cb1f1e0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-17578f1d-a26f-42a1-bd62-9896c8185c78 tempest-ProjectReaderTests-1890815915 None] Acquiring lock "cinder-quobyte-65c95b7a-9f60-420f-b7ec-ab903cb1f1e0" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-17578f1d-a26f-42a1-bd62-9896c8185c78 tempest-ProjectReaderTests-1890815915 None] Lock "cinder-quobyte-65c95b7a-9f60-420f-b7ec-ab903cb1f1e0" acquired by "delete_volume" :: waited 0.037s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:10 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb0d9fb-97ba-46de-bc48-c76638e5d041]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-17578f1d-a26f-42a1-bd62-9896c8185c78 tempest-ProjectReaderTests-1890815915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-65c95b7a-9f60-420f-b7ec-ab903cb1f1e0 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:10 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-9e58ddee-90ea-4517-b3ae-bb61d4923185 1073741824" returned: 0 in 0.938s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:10 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:UPDATE=99,cinder:SELECT=94,cinder:INSERT=38,cinder:DELETE=9 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:03:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-9e58ddee-90ea-4517-b3ae-bb61d4923185 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:10 devstack sudo[104209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-65c95b7a-9f60-420f-b7ec-ab903cb1f1e0 Nov 04 19:03:10 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:10 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-9e58ddee-90ea-4517-b3ae-bb61d4923185 Nov 04 19:03:10 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:10 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Flow 'volume_create_manager' (152b4cbe-8490-437f-8d0a-df968e98182b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79613504-049b-4a52-8190-c9b77c2c8130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79613504-049b-4a52-8190-c9b77c2c8130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-439015898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b499a74e-446f-4a72-8259-d215038bf326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a9bc0f00b5049029e32b96206ed1008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:11Z,use_quota=True,user_id='565f7568695945b7bdaae9033dbadd08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ff513c-10be-46af-b374-4936fed8a903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ff513c-10be-46af-b374-4936fed8a903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1309a528-ea26-42f5-931f-1b3a78114b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1309a528-ea26-42f5-931f-1b3a78114b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b499a74e-446f-4a72-8259-d215038bf326', 'volume_name': 'volume-b499a74e-446f-4a72-8259-d215038bf326', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03748c73-6ad6-40c0-ac4c-5a93df89ae56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03748c73-6ad6-40c0-ac4c-5a93df89ae56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f326fabc-a732-4b97-af6e-93cecd2c82c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:11 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Volume b499a74e-446f-4a72-8259-d215038bf326: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b499a74e-446f-4a72-8259-d215038bf326', 'volume_size': 1} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:11 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-9e58ddee-90ea-4517-b3ae-bb61d4923185" returned: 0 in 0.607s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.944s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1224036772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0d34d66-eaef-4a82-81ba-8e9a0bf05f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a9bc0f00b5049029e32b96206ed1008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:09Z,use_quota=True,user_id='565f7568695945b7bdaae9033dbadd08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Creating volume c0d34d66-eaef-4a82-81ba-8e9a0bf05f1b {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:11 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c0d34d66-eaef-4a82-81ba-8e9a0bf05f1b 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a321bf8-0b09-4bc9-9080-6c0185f3111b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e58ddee-90ea-4517-b3ae-bb61d4923185', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:11 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:11 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c0d34d66-eaef-4a82-81ba-8e9a0bf05f1b 1073741824 Nov 04 19:03:11 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd0cb46-e2ac-4a9e-8451-65468ae2ba9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-17578f1d-a26f-42a1-bd62-9896c8185c78 tempest-ProjectReaderTests-1890815915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-65c95b7a-9f60-420f-b7ec-ab903cb1f1e0" returned: 0 in 0.951s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-17578f1d-a26f-42a1-bd62-9896c8185c78 tempest-ProjectReaderTests-1890815915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-65c95b7a-9f60-420f-b7ec-ab903cb1f1e0 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:11 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Volume volume-9e58ddee-90ea-4517-b3ae-bb61d4923185 (9e58ddee-90ea-4517-b3ae-bb61d4923185): created successfully Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd0cb46-e2ac-4a9e-8451-65468ae2ba9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:11 devstack sudo[104219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-65c95b7a-9f60-420f-b7ec-ab903cb1f1e0 Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Flow 'volume_create_manager' (2ad77dbd-01cd-4a58-b4e2-db8925f06bad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:11 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:11 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-eadea324-668e-4955-9062-ef7eb87b604e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Created volume successfully. Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Flow 'volume_create_manager' (2f6ac64b-ca92-4df1-a133-d9a1a550e38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8673bac2-7e4b-4b21-8b6b-7a2a390fa663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8673bac2-7e4b-4b21-8b6b-7a2a390fa663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1872815396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e11bc81-d136-41dc-871d-4e92d3ddaf95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a9bc0f00b5049029e32b96206ed1008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:11Z,use_quota=True,user_id='565f7568695945b7bdaae9033dbadd08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd18b8c-bd0e-442c-bc02-b22c309c7e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd18b8c-bd0e-442c-bc02-b22c309c7e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885c6b95-39e2-4b18-b58e-47a77908b103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885c6b95-39e2-4b18-b58e-47a77908b103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e11bc81-d136-41dc-871d-4e92d3ddaf95', 'volume_name': 'volume-2e11bc81-d136-41dc-871d-4e92d3ddaf95', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (427943fa-8f8f-47dd-905c-cb7884241d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (427943fa-8f8f-47dd-905c-cb7884241d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3906808-aab3-4c45-a6ec-10f7768a687d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:11 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Volume 2e11bc81-d136-41dc-871d-4e92d3ddaf95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e11bc81-d136-41dc-871d-4e92d3ddaf95', 'volume_size': 1} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:11 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-17578f1d-a26f-42a1-bd62-9896c8185c78 tempest-ProjectReaderTests-1890815915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-65c95b7a-9f60-420f-b7ec-ab903cb1f1e0" returned: 0 in 0.364s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-17578f1d-a26f-42a1-bd62-9896c8185c78 tempest-ProjectReaderTests-1890815915 None] Lock "cinder-quobyte-65c95b7a-9f60-420f-b7ec-ab903cb1f1e0" released by "delete_volume" :: held 1.408s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:11 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-17578f1d-a26f-42a1-bd62-9896c8185c78 tempest-ProjectReaderTests-1890815915 None] Created reservations ['80e5207a-86b9-4320-8650-1b38f6081a30', '1447879e-4cc3-4224-b7fb-0bab64784436', 'f73a4c66-414f-40af-9d6b-83b9872b0b73', 'de45cae1-be99-48ee-8b94-de06b17427c5'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-17578f1d-a26f-42a1-bd62-9896c8185c78 tempest-ProjectReaderTests-1890815915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-17578f1d-a26f-42a1-bd62-9896c8185c78 tempest-ProjectReaderTests-1890815915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:12 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-17578f1d-a26f-42a1-bd62-9896c8185c78 tempest-ProjectReaderTests-1890815915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:12 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-17578f1d-a26f-42a1-bd62-9896c8185c78 tempest-ProjectReaderTests-1890815915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-17578f1d-a26f-42a1-bd62-9896c8185c78 tempest-ProjectReaderTests-1890815915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-17578f1d-a26f-42a1-bd62-9896c8185c78 tempest-ProjectReaderTests-1890815915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:12 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c0d34d66-eaef-4a82-81ba-8e9a0bf05f1b 1073741824" returned: 0 in 0.777s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:12 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:03:12 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c0d34d66-eaef-4a82-81ba-8e9a0bf05f1b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:12 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c0d34d66-eaef-4a82-81ba-8e9a0bf05f1b Nov 04 19:03:12 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:12 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-17578f1d-a26f-42a1-bd62-9896c8185c78 tempest-ProjectReaderTests-1890815915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.357s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:12 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-17578f1d-a26f-42a1-bd62-9896c8185c78 tempest-ProjectReaderTests-1890815915 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:12 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-17578f1d-a26f-42a1-bd62-9896c8185c78 tempest-ProjectReaderTests-1890815915 None] Deleted volume successfully. Nov 04 19:03:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-17578f1d-a26f-42a1-bd62-9896c8185c78 tempest-ProjectReaderTests-1890815915 None] Lock "cinder-65c95b7a-9f60-420f-b7ec-ab903cb1f1e0-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:12 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c0d34d66-eaef-4a82-81ba-8e9a0bf05f1b" returned: 0 in 0.359s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:12 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.306s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:12 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-114362538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e0338f-b2db-49a2-8a06-83f6f7a453c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a9bc0f00b5049029e32b96206ed1008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:10Z,use_quota=True,user_id='565f7568695945b7bdaae9033dbadd08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:12 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Creating volume b4e0338f-b2db-49a2-8a06-83f6f7a453c0 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:12 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:12 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:12 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:12 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:03:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b4e0338f-b2db-49a2-8a06-83f6f7a453c0 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:12 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718e0ce8-da53-4287-82b2-52bb31ad1260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0d34d66-eaef-4a82-81ba-8e9a0bf05f1b', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:12 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde643a9-34b7-4405-8317-a6a548343963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:12 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b4e0338f-b2db-49a2-8a06-83f6f7a453c0 1073741824 Nov 04 19:03:12 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:12 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Volume volume-c0d34d66-eaef-4a82-81ba-8e9a0bf05f1b (c0d34d66-eaef-4a82-81ba-8e9a0bf05f1b): created successfully Nov 04 19:03:12 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde643a9-34b7-4405-8317-a6a548343963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:12 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Flow 'volume_create_manager' (9c9acfdd-a684-4133-b43e-1f7adbc40981) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:12 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-71399168-753f-452c-a02c-f11024fde992 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Created volume successfully. Nov 04 19:03:13 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b4e0338f-b2db-49a2-8a06-83f6f7a453c0 1073741824" returned: 0 in 0.859s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:13 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Flow 'volume_create_manager' (a17fd062-151e-44de-85ba-9354e8a2c8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6867221f-cd89-4dc6-bde4-ade90ef5a873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6867221f-cd89-4dc6-bde4-ade90ef5a873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2003828713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=274724ed-f67d-43d8-8e6b-02b1efbbe02b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea87425f2d484290acdafba6a9a8da94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:13Z,use_quota=True,user_id='d9df19934822409397e155341a49ab97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef953b2-2f89-44eb-87b3-7de81f77866b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef953b2-2f89-44eb-87b3-7de81f77866b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814e5484-de94-46a6-8aee-26af0ac97906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814e5484-de94-46a6-8aee-26af0ac97906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '274724ed-f67d-43d8-8e6b-02b1efbbe02b', 'volume_name': 'volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67cdcf69-2f25-48bd-8f76-9d00bf5c7e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67cdcf69-2f25-48bd-8f76-9d00bf5c7e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e36fa6c-8a28-4b22-a50e-c5fa8cb74bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:13 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Volume 274724ed-f67d-43d8-8e6b-02b1efbbe02b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b', 'volume_size': 1} Nov 04 19:03:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b4e0338f-b2db-49a2-8a06-83f6f7a453c0 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:13 devstack sudo[104241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b4e0338f-b2db-49a2-8a06-83f6f7a453c0 Nov 04 19:03:13 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:13 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b4e0338f-b2db-49a2-8a06-83f6f7a453c0" returned: 0 in 0.324s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:13 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.719s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:13 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-439015898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b499a74e-446f-4a72-8259-d215038bf326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a9bc0f00b5049029e32b96206ed1008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:11Z,use_quota=True,user_id='565f7568695945b7bdaae9033dbadd08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:13 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Creating volume b499a74e-446f-4a72-8259-d215038bf326 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:13 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:13 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:13 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:13 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:03:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b499a74e-446f-4a72-8259-d215038bf326 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:13 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1908ea9a-bbb8-4fba-809e-5e7f821bf3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4e0338f-b2db-49a2-8a06-83f6f7a453c0', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:14 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b499a74e-446f-4a72-8259-d215038bf326 1073741824 Nov 04 19:03:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1845ad4-b668-4fa3-b2bc-50d72ece026f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:14 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:14 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Volume volume-b4e0338f-b2db-49a2-8a06-83f6f7a453c0 (b4e0338f-b2db-49a2-8a06-83f6f7a453c0): created successfully Nov 04 19:03:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1845ad4-b668-4fa3-b2bc-50d72ece026f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Flow 'volume_create_manager' (b00637e7-0451-458d-9dec-6df0f9e93485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:14 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-a1506894-848e-4bed-98f8-5c20299188e2 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Created volume successfully. Nov 04 19:03:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-a59b1c6b-266a-421d-b162-fa83b3b1b176 req-25ddf97a-2163-4ef5-b8a1-6adb52f09bd9 tempest-TestShelveInstance-569206585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:14 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b499a74e-446f-4a72-8259-d215038bf326 1073741824" returned: 0 in 0.647s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b499a74e-446f-4a72-8259-d215038bf326 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:14 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b499a74e-446f-4a72-8259-d215038bf326 Nov 04 19:03:14 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:14 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b499a74e-446f-4a72-8259-d215038bf326" returned: 0 in 0.256s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.147s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1872815396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e11bc81-d136-41dc-871d-4e92d3ddaf95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a9bc0f00b5049029e32b96206ed1008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:11Z,use_quota=True,user_id='565f7568695945b7bdaae9033dbadd08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Creating volume 2e11bc81-d136-41dc-871d-4e92d3ddaf95 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:14 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:03:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e11bc81-d136-41dc-871d-4e92d3ddaf95 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f326fabc-a732-4b97-af6e-93cecd2c82c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b499a74e-446f-4a72-8259-d215038bf326', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:14 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e11bc81-d136-41dc-871d-4e92d3ddaf95 1073741824 Nov 04 19:03:14 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (504e65be-29cb-441e-94b5-f3d0a33d05ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:14 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Volume volume-b499a74e-446f-4a72-8259-d215038bf326 (b499a74e-446f-4a72-8259-d215038bf326): created successfully Nov 04 19:03:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (504e65be-29cb-441e-94b5-f3d0a33d05ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:14 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Flow 'volume_create_manager' (152b4cbe-8490-437f-8d0a-df968e98182b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:15 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-079c0e9f-6bc5-4e59-8772-8adb5aebe64a tempest-CreateVolumesFromSnapshotTest-1280290233 None] Created volume successfully. Nov 04 19:03:15 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e11bc81-d136-41dc-871d-4e92d3ddaf95 1073741824" returned: 0 in 0.464s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e11bc81-d136-41dc-871d-4e92d3ddaf95 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:15 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e11bc81-d136-41dc-871d-4e92d3ddaf95 Nov 04 19:03:15 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:15 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e11bc81-d136-41dc-871d-4e92d3ddaf95" returned: 0 in 0.243s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:15 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.099s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:15 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2003828713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=274724ed-f67d-43d8-8e6b-02b1efbbe02b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea87425f2d484290acdafba6a9a8da94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:13Z,use_quota=True,user_id='d9df19934822409397e155341a49ab97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:15 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Creating volume 274724ed-f67d-43d8-8e6b-02b1efbbe02b {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:15 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:15 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:15 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:15 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:03:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:15 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b 1073741824 Nov 04 19:03:15 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:15 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3906808-aab3-4c45-a6ec-10f7768a687d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e11bc81-d136-41dc-871d-4e92d3ddaf95', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:15 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (540402d1-2ade-4784-97fc-e338d906e3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:15 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Volume volume-2e11bc81-d136-41dc-871d-4e92d3ddaf95 (2e11bc81-d136-41dc-871d-4e92d3ddaf95): created successfully Nov 04 19:03:15 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (540402d1-2ade-4784-97fc-e338d906e3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:15 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Flow 'volume_create_manager' (2f6ac64b-ca92-4df1-a133-d9a1a550e38d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:15 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-0833996a-0a34-4445-912f-921282551557 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Created volume successfully. Nov 04 19:03:16 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-38e6d631-f5f2-4d3b-95cf-f4ab3bad2b18 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "cinder-2e11bc81-d136-41dc-871d-4e92d3ddaf95-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:16 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-38e6d631-f5f2-4d3b-95cf-f4ab3bad2b18 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-2e11bc81-d136-41dc-871d-4e92d3ddaf95-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:16 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-38e6d631-f5f2-4d3b-95cf-f4ab3bad2b18 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "cinder-quobyte-2e11bc81-d136-41dc-871d-4e92d3ddaf95" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:16 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-38e6d631-f5f2-4d3b-95cf-f4ab3bad2b18 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-quobyte-2e11bc81-d136-41dc-871d-4e92d3ddaf95" acquired by "delete_volume" :: waited 0.020s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:16 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de620fd-a421-406f-8d96-7ea4523fd28e]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-38e6d631-f5f2-4d3b-95cf-f4ab3bad2b18 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e11bc81-d136-41dc-871d-4e92d3ddaf95 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:16 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b 1073741824" returned: 0 in 0.602s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:16 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e11bc81-d136-41dc-871d-4e92d3ddaf95 Nov 04 19:03:16 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:16 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b Nov 04 19:03:16 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:16 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-38e6d631-f5f2-4d3b-95cf-f4ab3bad2b18 tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e11bc81-d136-41dc-871d-4e92d3ddaf95" returned: 0 in 0.455s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-38e6d631-f5f2-4d3b-95cf-f4ab3bad2b18 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e11bc81-d136-41dc-871d-4e92d3ddaf95 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:16 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b" returned: 0 in 0.316s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:16 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-a59b1c6b-266a-421d-b162-fa83b3b1b176 req-25ddf97a-2163-4ef5-b8a1-6adb52f09bd9 tempest-TestShelveInstance-569206585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.365s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:16 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e11bc81-d136-41dc-871d-4e92d3ddaf95 Nov 04 19:03:16 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-a59b1c6b-266a-421d-b162-fa83b3b1b176 req-25ddf97a-2163-4ef5-b8a1-6adb52f09bd9 tempest-TestShelveInstance-569206585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:16 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e36fa6c-8a28-4b22-a50e-c5fa8cb74bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:16 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a76723e8-a230-49c2-9eba-4441fe347407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:16 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Volume volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b (274724ed-f67d-43d8-8e6b-02b1efbbe02b): created successfully Nov 04 19:03:16 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a76723e8-a230-49c2-9eba-4441fe347407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:16 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Flow 'volume_create_manager' (a17fd062-151e-44de-85ba-9354e8a2c8ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:16 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-d3601fe3-60aa-4c8b-b844-f8ea05c3b697 tempest-SnapshotMetadataTestJSON-1395668693 None] Created volume successfully. Nov 04 19:03:16 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-a59b1c6b-266a-421d-b162-fa83b3b1b176 req-25ddf97a-2163-4ef5-b8a1-6adb52f09bd9 tempest-TestShelveInstance-569206585 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280', 'name': 'volume-5959aa91-350b-4071-a901-13098658a8df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86db5a7e-b3fc-4de7-bb90-e5ba9b8e685a', 'enforce_multipath': True} {{(pid=87119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:03:16 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-a59b1c6b-266a-421d-b162-fa83b3b1b176 req-25ddf97a-2163-4ef5-b8a1-6adb52f09bd9 tempest-TestShelveInstance-569206585 None] attachment_update completed successfully. Nov 04 19:03:16 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-38e6d631-f5f2-4d3b-95cf-f4ab3bad2b18 tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e11bc81-d136-41dc-871d-4e92d3ddaf95" returned: 0 in 0.308s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:16 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-38e6d631-f5f2-4d3b-95cf-f4ab3bad2b18 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-quobyte-2e11bc81-d136-41dc-871d-4e92d3ddaf95" released by "delete_volume" :: held 0.822s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:17 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-38e6d631-f5f2-4d3b-95cf-f4ab3bad2b18 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Created reservations ['e19d4047-0d0c-4d67-8f57-5a68d9aa438e', 'd064e282-7524-46ea-9963-f754a4c8fe20', '76adf45b-7969-42d3-8604-c484f6617c40', '03053a94-677d-4276-9b2d-b2b46dc50ee2'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-38e6d631-f5f2-4d3b-95cf-f4ab3bad2b18 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-38e6d631-f5f2-4d3b-95cf-f4ab3bad2b18 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:17 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-38e6d631-f5f2-4d3b-95cf-f4ab3bad2b18 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:17 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-38e6d631-f5f2-4d3b-95cf-f4ab3bad2b18 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-38e6d631-f5f2-4d3b-95cf-f4ab3bad2b18 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-38e6d631-f5f2-4d3b-95cf-f4ab3bad2b18 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:17 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a21a31e3-c1ff-42a3-b996-f0dc42825ebb tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "cinder-b499a74e-446f-4a72-8259-d215038bf326-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:17 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:03:17 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:17 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a21a31e3-c1ff-42a3-b996-f0dc42825ebb tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-b499a74e-446f-4a72-8259-d215038bf326-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:17 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a21a31e3-c1ff-42a3-b996-f0dc42825ebb tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "cinder-quobyte-b499a74e-446f-4a72-8259-d215038bf326" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:17 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a21a31e3-c1ff-42a3-b996-f0dc42825ebb tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-quobyte-b499a74e-446f-4a72-8259-d215038bf326" acquired by "delete_volume" :: waited 0.024s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:17 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d2d2d0-f30c-4850-90ae-edbf4e961ecc]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a21a31e3-c1ff-42a3-b996-f0dc42825ebb tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b499a74e-446f-4a72-8259-d215038bf326 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:17 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-38e6d631-f5f2-4d3b-95cf-f4ab3bad2b18 tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.345s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:17 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-38e6d631-f5f2-4d3b-95cf-f4ab3bad2b18 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:17 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-38e6d631-f5f2-4d3b-95cf-f4ab3bad2b18 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Deleted volume successfully. Nov 04 19:03:17 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-38e6d631-f5f2-4d3b-95cf-f4ab3bad2b18 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-2e11bc81-d136-41dc-871d-4e92d3ddaf95-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:17 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b499a74e-446f-4a72-8259-d215038bf326 Nov 04 19:03:17 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9ded8679-4007-41ee-b0c7-5355c702c3a7 tempest-SnapshotMetadataTestJSON-1395668693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9ded8679-4007-41ee-b0c7-5355c702c3a7 tempest-SnapshotMetadataTestJSON-1395668693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:18 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-9ded8679-4007-41ee-b0c7-5355c702c3a7 tempest-SnapshotMetadataTestJSON-1395668693 None] Creating offline snapshot ed7a1df1-9545-43d1-b077-7a6b84de36f5 of volume 274724ed-f67d-43d8-8e6b-02b1efbbe02b {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:03:18 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5eb5770-6085-4bfe-9e96-9080ef9a0a1c]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9ded8679-4007-41ee-b0c7-5355c702c3a7 tempest-SnapshotMetadataTestJSON-1395668693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:18 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a21a31e3-c1ff-42a3-b996-f0dc42825ebb tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b499a74e-446f-4a72-8259-d215038bf326" returned: 0 in 0.691s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a21a31e3-c1ff-42a3-b996-f0dc42825ebb tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b499a74e-446f-4a72-8259-d215038bf326 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:18 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b499a74e-446f-4a72-8259-d215038bf326 Nov 04 19:03:18 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:18 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b Nov 04 19:03:18 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:18 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a21a31e3-c1ff-42a3-b996-f0dc42825ebb tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b499a74e-446f-4a72-8259-d215038bf326" returned: 0 in 0.359s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:18 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a21a31e3-c1ff-42a3-b996-f0dc42825ebb tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-quobyte-b499a74e-446f-4a72-8259-d215038bf326" released by "delete_volume" :: held 1.129s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:18 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9ded8679-4007-41ee-b0c7-5355c702c3a7 tempest-SnapshotMetadataTestJSON-1395668693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b" returned: 0 in 0.594s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9ded8679-4007-41ee-b0c7-5355c702c3a7 tempest-SnapshotMetadataTestJSON-1395668693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b.ed7a1df1-9545-43d1-b077-7a6b84de36f5 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:18 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-a21a31e3-c1ff-42a3-b996-f0dc42825ebb tempest-CreateVolumesFromSnapshotTest-1280290233 None] Created reservations ['d0edee86-752f-4166-bfb9-34e4cb3db6aa', '33e74d6d-b254-4d4d-84d7-fefe6b2ff48a', '2cc25362-7481-463d-a5dd-97b530c567fd', 'c3c79f16-5958-4bb7-817c-adbb53843e76'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:18 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b.ed7a1df1-9545-43d1-b077-7a6b84de36f5 1G Nov 04 19:03:18 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a21a31e3-c1ff-42a3-b996-f0dc42825ebb tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a21a31e3-c1ff-42a3-b996-f0dc42825ebb tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:18 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a21a31e3-c1ff-42a3-b996-f0dc42825ebb tempest-CreateVolumesFromSnapshotTest-1280290233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:18 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a21a31e3-c1ff-42a3-b996-f0dc42825ebb tempest-CreateVolumesFromSnapshotTest-1280290233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a21a31e3-c1ff-42a3-b996-f0dc42825ebb tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a21a31e3-c1ff-42a3-b996-f0dc42825ebb tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:18 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:03:18 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:19 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a21a31e3-c1ff-42a3-b996-f0dc42825ebb tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.364s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:19 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-a21a31e3-c1ff-42a3-b996-f0dc42825ebb tempest-CreateVolumesFromSnapshotTest-1280290233 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:19 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-a21a31e3-c1ff-42a3-b996-f0dc42825ebb tempest-CreateVolumesFromSnapshotTest-1280290233 None] Deleted volume successfully. Nov 04 19:03:19 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a21a31e3-c1ff-42a3-b996-f0dc42825ebb tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-b499a74e-446f-4a72-8259-d215038bf326-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:19 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9ded8679-4007-41ee-b0c7-5355c702c3a7 tempest-SnapshotMetadataTestJSON-1395668693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b.ed7a1df1-9545-43d1-b077-7a6b84de36f5 1G" returned: 0 in 0.691s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9ded8679-4007-41ee-b0c7-5355c702c3a7 tempest-SnapshotMetadataTestJSON-1395668693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b.ed7a1df1-9545-43d1-b077-7a6b84de36f5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:19 devstack sudo[104317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b.ed7a1df1-9545-43d1-b077-7a6b84de36f5 Nov 04 19:03:19 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:19 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f325715f-32ae-4cf7-a2ac-1a75a52205d7 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "cinder-b4e0338f-b2db-49a2-8a06-83f6f7a453c0-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:19 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f325715f-32ae-4cf7-a2ac-1a75a52205d7 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-b4e0338f-b2db-49a2-8a06-83f6f7a453c0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:19 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f325715f-32ae-4cf7-a2ac-1a75a52205d7 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "cinder-quobyte-b4e0338f-b2db-49a2-8a06-83f6f7a453c0" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:19 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f325715f-32ae-4cf7-a2ac-1a75a52205d7 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-quobyte-b4e0338f-b2db-49a2-8a06-83f6f7a453c0" acquired by "delete_volume" :: waited 0.019s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:19 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a53aa0f-29e4-4a1d-89bc-4bcc3dbb734e]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f325715f-32ae-4cf7-a2ac-1a75a52205d7 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b4e0338f-b2db-49a2-8a06-83f6f7a453c0 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:19 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9ded8679-4007-41ee-b0c7-5355c702c3a7 tempest-SnapshotMetadataTestJSON-1395668693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b.ed7a1df1-9545-43d1-b077-7a6b84de36f5" returned: 0 in 0.444s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:19 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-9ded8679-4007-41ee-b0c7-5355c702c3a7 tempest-SnapshotMetadataTestJSON-1395668693 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b.ed7a1df1-9545-43d1-b077-7a6b84de36f5 is being set with open permissions: ugo+rw Nov 04 19:03:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9ded8679-4007-41ee-b0c7-5355c702c3a7 tempest-SnapshotMetadataTestJSON-1395668693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b.ed7a1df1-9545-43d1-b077-7a6b84de36f5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:19 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b.ed7a1df1-9545-43d1-b077-7a6b84de36f5 Nov 04 19:03:19 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:19 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b4e0338f-b2db-49a2-8a06-83f6f7a453c0 Nov 04 19:03:19 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:20 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9ded8679-4007-41ee-b0c7-5355c702c3a7 tempest-SnapshotMetadataTestJSON-1395668693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b.ed7a1df1-9545-43d1-b077-7a6b84de36f5" returned: 0 in 0.340s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9ded8679-4007-41ee-b0c7-5355c702c3a7 tempest-SnapshotMetadataTestJSON-1395668693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:20 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b.info Nov 04 19:03:20 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:20 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f325715f-32ae-4cf7-a2ac-1a75a52205d7 tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b4e0338f-b2db-49a2-8a06-83f6f7a453c0" returned: 0 in 0.502s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f325715f-32ae-4cf7-a2ac-1a75a52205d7 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b4e0338f-b2db-49a2-8a06-83f6f7a453c0 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:20 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b4e0338f-b2db-49a2-8a06-83f6f7a453c0 Nov 04 19:03:20 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:20 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9ded8679-4007-41ee-b0c7-5355c702c3a7 tempest-SnapshotMetadataTestJSON-1395668693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b.info" returned: 0 in 0.339s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:20 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-9ded8679-4007-41ee-b0c7-5355c702c3a7 tempest-SnapshotMetadataTestJSON-1395668693 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b.info is being set with open permissions: ugo+rw Nov 04 19:03:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9ded8679-4007-41ee-b0c7-5355c702c3a7 tempest-SnapshotMetadataTestJSON-1395668693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:20 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b.info Nov 04 19:03:20 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:20 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f325715f-32ae-4cf7-a2ac-1a75a52205d7 tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b4e0338f-b2db-49a2-8a06-83f6f7a453c0" returned: 0 in 0.359s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:20 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f325715f-32ae-4cf7-a2ac-1a75a52205d7 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-quobyte-b4e0338f-b2db-49a2-8a06-83f6f7a453c0" released by "delete_volume" :: held 0.919s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:20 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-f325715f-32ae-4cf7-a2ac-1a75a52205d7 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Created reservations ['df2c60a4-9137-4b4f-997b-c735c4e8dc8d', 'cdfdb965-a25d-4345-b29c-108876b4d4f9', 'cbb5ba4c-0942-47b4-9bed-66465e8918df', '7d3b78e6-0bd7-481e-83cd-e9dec8c2eb23'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f325715f-32ae-4cf7-a2ac-1a75a52205d7 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f325715f-32ae-4cf7-a2ac-1a75a52205d7 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f325715f-32ae-4cf7-a2ac-1a75a52205d7 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f325715f-32ae-4cf7-a2ac-1a75a52205d7 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f325715f-32ae-4cf7-a2ac-1a75a52205d7 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f325715f-32ae-4cf7-a2ac-1a75a52205d7 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:20 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:03:20 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:20 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d0a50b74-3db8-4c77-a0dc-4d77904b2f02 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "cinder-c0d34d66-eaef-4a82-81ba-8e9a0bf05f1b-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:20 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9ded8679-4007-41ee-b0c7-5355c702c3a7 tempest-SnapshotMetadataTestJSON-1395668693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b.info" returned: 0 in 0.412s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9ded8679-4007-41ee-b0c7-5355c702c3a7 tempest-SnapshotMetadataTestJSON-1395668693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.984s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:21 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d0a50b74-3db8-4c77-a0dc-4d77904b2f02 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-c0d34d66-eaef-4a82-81ba-8e9a0bf05f1b-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:21 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-9ded8679-4007-41ee-b0c7-5355c702c3a7 tempest-SnapshotMetadataTestJSON-1395668693 None] Create snapshot completed successfully Nov 04 19:03:21 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d0a50b74-3db8-4c77-a0dc-4d77904b2f02 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "cinder-quobyte-c0d34d66-eaef-4a82-81ba-8e9a0bf05f1b" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:21 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d0a50b74-3db8-4c77-a0dc-4d77904b2f02 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-quobyte-c0d34d66-eaef-4a82-81ba-8e9a0bf05f1b" acquired by "delete_volume" :: waited 0.032s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:21 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[754e9efb-6a2c-4d61-a6a9-14fe2b4e0d79]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d0a50b74-3db8-4c77-a0dc-4d77904b2f02 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c0d34d66-eaef-4a82-81ba-8e9a0bf05f1b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:21 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f325715f-32ae-4cf7-a2ac-1a75a52205d7 tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.581s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:21 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-f325715f-32ae-4cf7-a2ac-1a75a52205d7 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:21 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-f325715f-32ae-4cf7-a2ac-1a75a52205d7 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Deleted volume successfully. Nov 04 19:03:21 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f325715f-32ae-4cf7-a2ac-1a75a52205d7 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-b4e0338f-b2db-49a2-8a06-83f6f7a453c0-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:21 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c0d34d66-eaef-4a82-81ba-8e9a0bf05f1b Nov 04 19:03:21 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:22 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d0a50b74-3db8-4c77-a0dc-4d77904b2f02 tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c0d34d66-eaef-4a82-81ba-8e9a0bf05f1b" returned: 0 in 0.971s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d0a50b74-3db8-4c77-a0dc-4d77904b2f02 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c0d34d66-eaef-4a82-81ba-8e9a0bf05f1b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:22 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c0d34d66-eaef-4a82-81ba-8e9a0bf05f1b Nov 04 19:03:22 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:22 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d0a50b74-3db8-4c77-a0dc-4d77904b2f02 tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c0d34d66-eaef-4a82-81ba-8e9a0bf05f1b" returned: 0 in 0.430s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:22 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d0a50b74-3db8-4c77-a0dc-4d77904b2f02 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-quobyte-c0d34d66-eaef-4a82-81ba-8e9a0bf05f1b" released by "delete_volume" :: held 1.518s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:22 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-d0a50b74-3db8-4c77-a0dc-4d77904b2f02 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Created reservations ['94126714-1b11-4149-a098-a643df2668fe', '452df610-bcc2-4de4-80d3-0459f170689e', 'c139ad56-2f79-49fb-aaa1-7fa08d5ad215', '65feaaad-94f1-4da5-a1bc-85b0eb5e84ac'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d0a50b74-3db8-4c77-a0dc-4d77904b2f02 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d0a50b74-3db8-4c77-a0dc-4d77904b2f02 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:22 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d0a50b74-3db8-4c77-a0dc-4d77904b2f02 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:22 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d0a50b74-3db8-4c77-a0dc-4d77904b2f02 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d0a50b74-3db8-4c77-a0dc-4d77904b2f02 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d0a50b74-3db8-4c77-a0dc-4d77904b2f02 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:22 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:03:22 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:23 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e1057c24-e53e-4dc4-aaf7-c8601fc078a6 tempest-SnapshotMetadataTestJSON-1395668693 None] Acquiring lock "cinder-ed7a1df1-9545-43d1-b077-7a6b84de36f5-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:23 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e1057c24-e53e-4dc4-aaf7-c8601fc078a6 tempest-SnapshotMetadataTestJSON-1395668693 None] Lock "cinder-ed7a1df1-9545-43d1-b077-7a6b84de36f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:23 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e1057c24-e53e-4dc4-aaf7-c8601fc078a6 tempest-SnapshotMetadataTestJSON-1395668693 None] Acquiring lock "cinder-quobyte-274724ed-f67d-43d8-8e6b-02b1efbbe02b" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:23 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e1057c24-e53e-4dc4-aaf7-c8601fc078a6 tempest-SnapshotMetadataTestJSON-1395668693 None] Lock "cinder-quobyte-274724ed-f67d-43d8-8e6b-02b1efbbe02b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:23 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e1057c24-e53e-4dc4-aaf7-c8601fc078a6 tempest-SnapshotMetadataTestJSON-1395668693 None] Acquiring lock "cinder-quobyte-ed7a1df1-9545-43d1-b077-7a6b84de36f5" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:23 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e1057c24-e53e-4dc4-aaf7-c8601fc078a6 tempest-SnapshotMetadataTestJSON-1395668693 None] Lock "cinder-quobyte-ed7a1df1-9545-43d1-b077-7a6b84de36f5" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:23 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-e1057c24-e53e-4dc4-aaf7-c8601fc078a6 tempest-SnapshotMetadataTestJSON-1395668693 None] Deleting offline snapshot ed7a1df1-9545-43d1-b077-7a6b84de36f5 of volume 274724ed-f67d-43d8-8e6b-02b1efbbe02b {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:03:23 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-e1057c24-e53e-4dc4-aaf7-c8601fc078a6 tempest-SnapshotMetadataTestJSON-1395668693 None] snapshot_file for this snap is: volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b.ed7a1df1-9545-43d1-b077-7a6b84de36f5 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:03:23 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d0a50b74-3db8-4c77-a0dc-4d77904b2f02 tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.340s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:23 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-d0a50b74-3db8-4c77-a0dc-4d77904b2f02 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:23 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed40619-7a3f-486c-87f3-9c6befc13050]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e1057c24-e53e-4dc4-aaf7-c8601fc078a6 tempest-SnapshotMetadataTestJSON-1395668693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b.ed7a1df1-9545-43d1-b077-7a6b84de36f5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:23 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-d0a50b74-3db8-4c77-a0dc-4d77904b2f02 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Deleted volume successfully. Nov 04 19:03:23 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-723d0a2a-8fd2-4a7e-99da-fcb3d0b50c7e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "cinder-9e58ddee-90ea-4517-b3ae-bb61d4923185-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:23 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d0a50b74-3db8-4c77-a0dc-4d77904b2f02 tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-c0d34d66-eaef-4a82-81ba-8e9a0bf05f1b-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:23 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-723d0a2a-8fd2-4a7e-99da-fcb3d0b50c7e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-9e58ddee-90ea-4517-b3ae-bb61d4923185-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:23 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-723d0a2a-8fd2-4a7e-99da-fcb3d0b50c7e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "cinder-quobyte-9e58ddee-90ea-4517-b3ae-bb61d4923185" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:23 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b.ed7a1df1-9545-43d1-b077-7a6b84de36f5 Nov 04 19:03:23 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:23 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-723d0a2a-8fd2-4a7e-99da-fcb3d0b50c7e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-quobyte-9e58ddee-90ea-4517-b3ae-bb61d4923185" acquired by "delete_volume" :: waited 0.037s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:23 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f237bf5-474d-46de-bad0-69401543597e]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-723d0a2a-8fd2-4a7e-99da-fcb3d0b50c7e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-9e58ddee-90ea-4517-b3ae-bb61d4923185 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:23 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-9e58ddee-90ea-4517-b3ae-bb61d4923185 Nov 04 19:03:23 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:23 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e1057c24-e53e-4dc4-aaf7-c8601fc078a6 tempest-SnapshotMetadataTestJSON-1395668693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b.ed7a1df1-9545-43d1-b077-7a6b84de36f5" returned: 0 in 0.444s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:23 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-e1057c24-e53e-4dc4-aaf7-c8601fc078a6 tempest-SnapshotMetadataTestJSON-1395668693 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:03:23 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[99094cc8-f32a-470b-a957-a808736379c6]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e1057c24-e53e-4dc4-aaf7-c8601fc078a6 tempest-SnapshotMetadataTestJSON-1395668693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:23 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b Nov 04 19:03:23 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:23 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-723d0a2a-8fd2-4a7e-99da-fcb3d0b50c7e tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-9e58ddee-90ea-4517-b3ae-bb61d4923185" returned: 0 in 0.448s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-723d0a2a-8fd2-4a7e-99da-fcb3d0b50c7e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-9e58ddee-90ea-4517-b3ae-bb61d4923185 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:23 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-9e58ddee-90ea-4517-b3ae-bb61d4923185 Nov 04 19:03:23 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:24 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e1057c24-e53e-4dc4-aaf7-c8601fc078a6 tempest-SnapshotMetadataTestJSON-1395668693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b" returned: 0 in 0.496s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e1057c24-e53e-4dc4-aaf7-c8601fc078a6 tempest-SnapshotMetadataTestJSON-1395668693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b.ed7a1df1-9545-43d1-b077-7a6b84de36f5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:24 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-723d0a2a-8fd2-4a7e-99da-fcb3d0b50c7e tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-9e58ddee-90ea-4517-b3ae-bb61d4923185" returned: 0 in 0.345s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:24 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b.ed7a1df1-9545-43d1-b077-7a6b84de36f5 Nov 04 19:03:24 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:24 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-723d0a2a-8fd2-4a7e-99da-fcb3d0b50c7e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-quobyte-9e58ddee-90ea-4517-b3ae-bb61d4923185" released by "delete_volume" :: held 0.856s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:24 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-723d0a2a-8fd2-4a7e-99da-fcb3d0b50c7e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Created reservations ['338c6102-c3c7-4c8e-b629-a9d421086ee5', '1fc2b01a-d100-4ccf-92f6-80e95381b64a', 'fe6b5204-f02a-45e4-8f32-48e8962b008d', '095ff30a-7eef-4e40-8abf-83527cddb1c0'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-723d0a2a-8fd2-4a7e-99da-fcb3d0b50c7e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-723d0a2a-8fd2-4a7e-99da-fcb3d0b50c7e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:24 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-723d0a2a-8fd2-4a7e-99da-fcb3d0b50c7e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:24 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-723d0a2a-8fd2-4a7e-99da-fcb3d0b50c7e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-723d0a2a-8fd2-4a7e-99da-fcb3d0b50c7e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-723d0a2a-8fd2-4a7e-99da-fcb3d0b50c7e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:24 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:03:24 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:24 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-24efb98a-5c65-42d1-baf1-07a253badf6f tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "cinder-54f31c52-9852-409f-a751-3a9a27d86848-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:24 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-24efb98a-5c65-42d1-baf1-07a253badf6f tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-54f31c52-9852-409f-a751-3a9a27d86848-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:24 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-24efb98a-5c65-42d1-baf1-07a253badf6f tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "cinder-quobyte-1d99430f-d9ff-4bfa-bf77-c42d190af90f" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:24 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-24efb98a-5c65-42d1-baf1-07a253badf6f tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-quobyte-1d99430f-d9ff-4bfa-bf77-c42d190af90f" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:24 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-24efb98a-5c65-42d1-baf1-07a253badf6f tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "cinder-quobyte-54f31c52-9852-409f-a751-3a9a27d86848" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:24 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-24efb98a-5c65-42d1-baf1-07a253badf6f tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-quobyte-54f31c52-9852-409f-a751-3a9a27d86848" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:24 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-24efb98a-5c65-42d1-baf1-07a253badf6f tempest-CreateVolumesFromSnapshotTest-1280290233 None] Deleting offline snapshot 54f31c52-9852-409f-a751-3a9a27d86848 of volume 1d99430f-d9ff-4bfa-bf77-c42d190af90f {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:03:24 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-24efb98a-5c65-42d1-baf1-07a253badf6f tempest-CreateVolumesFromSnapshotTest-1280290233 None] snapshot_file for this snap is: volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f.54f31c52-9852-409f-a751-3a9a27d86848 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:03:24 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:24 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[a359b705-ab40-4dbe-8031-df086839c834]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-24efb98a-5c65-42d1-baf1-07a253badf6f tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f.54f31c52-9852-409f-a751-3a9a27d86848 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e1057c24-e53e-4dc4-aaf7-c8601fc078a6 tempest-SnapshotMetadataTestJSON-1395668693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b.ed7a1df1-9545-43d1-b077-7a6b84de36f5" returned: 0 in 0.499s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e1057c24-e53e-4dc4-aaf7-c8601fc078a6 tempest-SnapshotMetadataTestJSON-1395668693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b.ed7a1df1-9545-43d1-b077-7a6b84de36f5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:24 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-723d0a2a-8fd2-4a7e-99da-fcb3d0b50c7e tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.352s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:24 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-723d0a2a-8fd2-4a7e-99da-fcb3d0b50c7e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:24 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-723d0a2a-8fd2-4a7e-99da-fcb3d0b50c7e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Deleted volume successfully. Nov 04 19:03:24 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b.ed7a1df1-9545-43d1-b077-7a6b84de36f5 Nov 04 19:03:24 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:24 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-723d0a2a-8fd2-4a7e-99da-fcb3d0b50c7e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-9e58ddee-90ea-4517-b3ae-bb61d4923185-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:24 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f.54f31c52-9852-409f-a751-3a9a27d86848 Nov 04 19:03:24 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:25 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e1057c24-e53e-4dc4-aaf7-c8601fc078a6 tempest-SnapshotMetadataTestJSON-1395668693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b.ed7a1df1-9545-43d1-b077-7a6b84de36f5" returned: 0 in 0.345s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:25 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e1057c24-e53e-4dc4-aaf7-c8601fc078a6 tempest-SnapshotMetadataTestJSON-1395668693 None] Lock "cinder-quobyte-ed7a1df1-9545-43d1-b077-7a6b84de36f5" released by "_delete_snapshot" :: held 1.929s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:25 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e1057c24-e53e-4dc4-aaf7-c8601fc078a6 tempest-SnapshotMetadataTestJSON-1395668693 None] Lock "cinder-quobyte-274724ed-f67d-43d8-8e6b-02b1efbbe02b" released by "delete_snapshot" :: held 1.962s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:25 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-24efb98a-5c65-42d1-baf1-07a253badf6f tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f.54f31c52-9852-409f-a751-3a9a27d86848" returned: 0 in 0.481s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-24efb98a-5c65-42d1-baf1-07a253badf6f tempest-CreateVolumesFromSnapshotTest-1280290233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:03:25 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-e1057c24-e53e-4dc4-aaf7-c8601fc078a6 tempest-SnapshotMetadataTestJSON-1395668693 None] Created reservations ['0fc27f04-d4c9-43f7-a854-0d8e0cf036b6', '0e1df26b-713d-4739-8dcf-16120fc55c93', '69bd63ba-8629-463d-8349-6798b8897518', '051dd95f-7c02-4aba-aea9-12de8e9ee099'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:25 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd160ecb-cbe3-4ebf-b849-e8af39a43f5e]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-24efb98a-5c65-42d1-baf1-07a253badf6f tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager._thread_info {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:03:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread count: 28 {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:03:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread info: [<_MainThread(MainThread, started 130247852032128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:03:25 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e1057c24-e53e-4dc4-aaf7-c8601fc078a6 tempest-SnapshotMetadataTestJSON-1395668693 None] Delete snapshot completed successfully. Nov 04 19:03:25 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e1057c24-e53e-4dc4-aaf7-c8601fc078a6 tempest-SnapshotMetadataTestJSON-1395668693 None] Lock "cinder-ed7a1df1-9545-43d1-b077-7a6b84de36f5-delete_snapshot" released by "delete_snapshot" :: held 2.189s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:25 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f Nov 04 19:03:25 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:25 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-24efb98a-5c65-42d1-baf1-07a253badf6f tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f" returned: 0 in 0.420s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-24efb98a-5c65-42d1-baf1-07a253badf6f tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f.54f31c52-9852-409f-a751-3a9a27d86848 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:25 devstack sudo[104877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f.54f31c52-9852-409f-a751-3a9a27d86848 Nov 04 19:03:25 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:26 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-24efb98a-5c65-42d1-baf1-07a253badf6f tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f.54f31c52-9852-409f-a751-3a9a27d86848" returned: 0 in 0.348s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-24efb98a-5c65-42d1-baf1-07a253badf6f tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f.54f31c52-9852-409f-a751-3a9a27d86848 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:26 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f.54f31c52-9852-409f-a751-3a9a27d86848 Nov 04 19:03:26 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:26 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-24efb98a-5c65-42d1-baf1-07a253badf6f tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f.54f31c52-9852-409f-a751-3a9a27d86848" returned: 0 in 0.250s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:26 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-24efb98a-5c65-42d1-baf1-07a253badf6f tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-quobyte-54f31c52-9852-409f-a751-3a9a27d86848" released by "_delete_snapshot" :: held 1.660s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:26 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-24efb98a-5c65-42d1-baf1-07a253badf6f tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-quobyte-1d99430f-d9ff-4bfa-bf77-c42d190af90f" released by "delete_snapshot" :: held 1.698s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:26 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-24efb98a-5c65-42d1-baf1-07a253badf6f tempest-CreateVolumesFromSnapshotTest-1280290233 None] Created reservations ['3ba32a83-8e83-4c80-9b0b-686d4a5e70b5', '2579ec30-1ec9-4b2b-8ad2-5b2acb275a5e', 'e6d1f8f3-dd89-46d5-aa95-17f992a5ad80', '81f68a7c-86c0-42bd-b4f9-e9bb902df131'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:26 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-8983d818-6fda-438a-ab1d-af7378a32041 tempest-SnapshotMetadataTestJSON-1395668693 None] Acquiring lock "cinder-274724ed-f67d-43d8-8e6b-02b1efbbe02b-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:26 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-8983d818-6fda-438a-ab1d-af7378a32041 tempest-SnapshotMetadataTestJSON-1395668693 None] Lock "cinder-274724ed-f67d-43d8-8e6b-02b1efbbe02b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:26 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-24efb98a-5c65-42d1-baf1-07a253badf6f tempest-CreateVolumesFromSnapshotTest-1280290233 None] Delete snapshot completed successfully. Nov 04 19:03:26 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-24efb98a-5c65-42d1-baf1-07a253badf6f tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-54f31c52-9852-409f-a751-3a9a27d86848-delete_snapshot" released by "delete_snapshot" :: held 1.924s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:26 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-8983d818-6fda-438a-ab1d-af7378a32041 tempest-SnapshotMetadataTestJSON-1395668693 None] Acquiring lock "cinder-quobyte-274724ed-f67d-43d8-8e6b-02b1efbbe02b" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:26 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-8983d818-6fda-438a-ab1d-af7378a32041 tempest-SnapshotMetadataTestJSON-1395668693 None] Lock "cinder-quobyte-274724ed-f67d-43d8-8e6b-02b1efbbe02b" acquired by "delete_volume" :: waited 0.017s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:26 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c59f42-733d-4e40-b2c8-cc7e12c3706a]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8983d818-6fda-438a-ab1d-af7378a32041 tempest-SnapshotMetadataTestJSON-1395668693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:26 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b Nov 04 19:03:26 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:26 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-52b2caef-726d-490e-b693-d1466b7bb74e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "cinder-1d99430f-d9ff-4bfa-bf77-c42d190af90f-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:26 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-52b2caef-726d-490e-b693-d1466b7bb74e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-1d99430f-d9ff-4bfa-bf77-c42d190af90f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:26 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-52b2caef-726d-490e-b693-d1466b7bb74e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "cinder-quobyte-1d99430f-d9ff-4bfa-bf77-c42d190af90f" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:26 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-52b2caef-726d-490e-b693-d1466b7bb74e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-quobyte-1d99430f-d9ff-4bfa-bf77-c42d190af90f" acquired by "delete_volume" :: waited 0.027s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:26 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1f0e40-788c-457d-abf6-703d36382efa]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-52b2caef-726d-490e-b693-d1466b7bb74e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:27 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8983d818-6fda-438a-ab1d-af7378a32041 tempest-SnapshotMetadataTestJSON-1395668693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b" returned: 0 in 0.462s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8983d818-6fda-438a-ab1d-af7378a32041 tempest-SnapshotMetadataTestJSON-1395668693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:27 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b Nov 04 19:03:27 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:27 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f Nov 04 19:03:27 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:27 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8983d818-6fda-438a-ab1d-af7378a32041 tempest-SnapshotMetadataTestJSON-1395668693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-274724ed-f67d-43d8-8e6b-02b1efbbe02b" returned: 0 in 0.274s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:27 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-8983d818-6fda-438a-ab1d-af7378a32041 tempest-SnapshotMetadataTestJSON-1395668693 None] Lock "cinder-quobyte-274724ed-f67d-43d8-8e6b-02b1efbbe02b" released by "delete_volume" :: held 0.823s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:27 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-52b2caef-726d-490e-b693-d1466b7bb74e tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f" returned: 0 in 0.394s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-52b2caef-726d-490e-b693-d1466b7bb74e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:27 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f Nov 04 19:03:27 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:27 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-8983d818-6fda-438a-ab1d-af7378a32041 tempest-SnapshotMetadataTestJSON-1395668693 None] Created reservations ['dc8decad-66ce-4f5b-becd-a1a469aae8c6', '2aad65c6-eb37-44db-8795-19ab38679386', '849c0515-ac0c-4feb-b7f7-2503e5ac23f1', 'd83e7e61-1097-480a-a94d-97763964f493'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8983d818-6fda-438a-ab1d-af7378a32041 tempest-SnapshotMetadataTestJSON-1395668693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8983d818-6fda-438a-ab1d-af7378a32041 tempest-SnapshotMetadataTestJSON-1395668693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:27 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8983d818-6fda-438a-ab1d-af7378a32041 tempest-SnapshotMetadataTestJSON-1395668693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:27 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8983d818-6fda-438a-ab1d-af7378a32041 tempest-SnapshotMetadataTestJSON-1395668693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8983d818-6fda-438a-ab1d-af7378a32041 tempest-SnapshotMetadataTestJSON-1395668693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8983d818-6fda-438a-ab1d-af7378a32041 tempest-SnapshotMetadataTestJSON-1395668693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:27 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:03:27 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:27 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-52b2caef-726d-490e-b693-d1466b7bb74e tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1d99430f-d9ff-4bfa-bf77-c42d190af90f" returned: 0 in 0.324s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:27 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-52b2caef-726d-490e-b693-d1466b7bb74e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-quobyte-1d99430f-d9ff-4bfa-bf77-c42d190af90f" released by "delete_volume" :: held 0.814s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:27 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8983d818-6fda-438a-ab1d-af7378a32041 tempest-SnapshotMetadataTestJSON-1395668693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.275s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:27 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-8983d818-6fda-438a-ab1d-af7378a32041 tempest-SnapshotMetadataTestJSON-1395668693 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:27 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-8983d818-6fda-438a-ab1d-af7378a32041 tempest-SnapshotMetadataTestJSON-1395668693 None] Deleted volume successfully. Nov 04 19:03:27 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-52b2caef-726d-490e-b693-d1466b7bb74e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Created reservations ['092ab00d-1615-49d2-9e4e-f12bf8fe5a1f', 'dd639d6e-ad93-4b88-b3ce-25100674f648', '0245ce21-9b32-47f0-88c5-7a2af7ebff0d', '137af3da-d0ed-4bfd-a272-c4bbd5f7cf08'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:27 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-8983d818-6fda-438a-ab1d-af7378a32041 tempest-SnapshotMetadataTestJSON-1395668693 None] Lock "cinder-274724ed-f67d-43d8-8e6b-02b1efbbe02b-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-52b2caef-726d-490e-b693-d1466b7bb74e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-52b2caef-726d-490e-b693-d1466b7bb74e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:27 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-52b2caef-726d-490e-b693-d1466b7bb74e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:27 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-52b2caef-726d-490e-b693-d1466b7bb74e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-52b2caef-726d-490e-b693-d1466b7bb74e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-52b2caef-726d-490e-b693-d1466b7bb74e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:27 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:03:27 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:28 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-52b2caef-726d-490e-b693-d1466b7bb74e tempest-CreateVolumesFromSnapshotTest-1280290233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.369s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:28 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-52b2caef-726d-490e-b693-d1466b7bb74e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:28 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-52b2caef-726d-490e-b693-d1466b7bb74e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Deleted volume successfully. Nov 04 19:03:28 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-52b2caef-726d-490e-b693-d1466b7bb74e tempest-CreateVolumesFromSnapshotTest-1280290233 None] Lock "cinder-1d99430f-d9ff-4bfa-bf77-c42d190af90f-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:31 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Flow 'volume_create_manager' (0e6684b0-6c62-4bf5-a849-5758acbaabfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17de2f95-7676-4395-beaf-78e2d28c9167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17de2f95-7676-4395-beaf-78e2d28c9167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1732833915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd5bb75-e419-482c-bc59-c54844365a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c49bee974c14a7ea270d3686482d03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:31Z,use_quota=True,user_id='7dd7913f37184183add6cac66b363aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00e1534-a7bb-462c-8d1f-fcfa1040b6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00e1534-a7bb-462c-8d1f-fcfa1040b6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c1cc8d6-3477-44af-a284-9477ce7f97cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c1cc8d6-3477-44af-a284-9477ce7f97cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bd5bb75-e419-482c-bc59-c54844365a0c', 'volume_name': 'volume-6bd5bb75-e419-482c-bc59-c54844365a0c', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f16e33-74a5-4141-90b4-c6b08b7ab39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f16e33-74a5-4141-90b4-c6b08b7ab39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e742c68-8bce-424b-8fc6-35d74ad86514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:31 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Volume 6bd5bb75-e419-482c-bc59-c54844365a0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bd5bb75-e419-482c-bc59-c54844365a0c', 'volume_size': 1} Nov 04 19:03:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1732833915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd5bb75-e419-482c-bc59-c54844365a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c49bee974c14a7ea270d3686482d03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:31Z,use_quota=True,user_id='7dd7913f37184183add6cac66b363aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Creating volume 6bd5bb75-e419-482c-bc59-c54844365a0c {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:31 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:03:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6bd5bb75-e419-482c-bc59-c54844365a0c 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:31 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6bd5bb75-e419-482c-bc59-c54844365a0c 1073741824 Nov 04 19:03:31 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:31 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6bd5bb75-e419-482c-bc59-c54844365a0c 1073741824" returned: 0 in 0.504s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6bd5bb75-e419-482c-bc59-c54844365a0c {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:31 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:31 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6bd5bb75-e419-482c-bc59-c54844365a0c Nov 04 19:03:31 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Flow 'volume_create_manager' (1b33501c-9fbc-4e6c-bdf3-85e67d1ab005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f33a06-cf99-4c9a-b45e-488430f14cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f33a06-cf99-4c9a-b45e-488430f14cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-707089871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e2ea922-6493-405f-a9bc-a45d7947042d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17f3acfa1184e199eff21b1255e6e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:32Z,use_quota=True,user_id='594ba10518fc4bab8279ff555530de21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56797de-e607-4f10-a3ec-2abf9ab9b7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56797de-e607-4f10-a3ec-2abf9ab9b7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e54e18-f41c-488b-9298-ab7deeff20ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e54e18-f41c-488b-9298-ab7deeff20ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e2ea922-6493-405f-a9bc-a45d7947042d', 'volume_name': 'volume-3e2ea922-6493-405f-a9bc-a45d7947042d', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc39e4b-c3e9-44c0-89a6-467a82da8d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc39e4b-c3e9-44c0-89a6-467a82da8d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f123b57f-c817-4271-b3e4-3996f1ddd381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:32 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Volume 3e2ea922-6493-405f-a9bc-a45d7947042d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e2ea922-6493-405f-a9bc-a45d7947042d', 'volume_size': 1} Nov 04 19:03:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:32 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6bd5bb75-e419-482c-bc59-c54844365a0c" returned: 0 in 0.280s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.174s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-707089871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e2ea922-6493-405f-a9bc-a45d7947042d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17f3acfa1184e199eff21b1255e6e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:32Z,use_quota=True,user_id='594ba10518fc4bab8279ff555530de21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Creating volume 3e2ea922-6493-405f-a9bc-a45d7947042d {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:32 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:03:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e742c68-8bce-424b-8fc6-35d74ad86514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bd5bb75-e419-482c-bc59-c54844365a0c', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:32 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d 1073741824 Nov 04 19:03:32 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0596019f-dedc-4580-8096-a04614c15215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:32 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Volume volume-6bd5bb75-e419-482c-bc59-c54844365a0c (6bd5bb75-e419-482c-bc59-c54844365a0c): created successfully Nov 04 19:03:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0596019f-dedc-4580-8096-a04614c15215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Flow 'volume_create_manager' (0e6684b0-6c62-4bf5-a849-5758acbaabfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:32 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-3bd44d8f-5b70-41dd-a483-4272d5c2db09 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Created volume successfully. Nov 04 19:03:32 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d 1073741824" returned: 0 in 0.462s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:32 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d Nov 04 19:03:32 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:33 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d" returned: 0 in 0.273s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f123b57f-c817-4271-b3e4-3996f1ddd381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e2ea922-6493-405f-a9bc-a45d7947042d', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5656bed3-d345-4a87-91f0-ac47fee061b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:33 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Volume volume-3e2ea922-6493-405f-a9bc-a45d7947042d (3e2ea922-6493-405f-a9bc-a45d7947042d): created successfully Nov 04 19:03:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5656bed3-d345-4a87-91f0-ac47fee061b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Flow 'volume_create_manager' (1b33501c-9fbc-4e6c-bdf3-85e67d1ab005) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:33 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-95bc50dc-4c4a-43f6-b788-eb6c53334443 tempest-VolumesDeleteCascade-1472720059 None] Created volume successfully. Nov 04 19:03:33 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Flow 'volume_create_manager' (3eaa0c99-4f85-4a0c-b6f6-72e6a449c5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf0e5fa9-ca72-4d4a-ac2d-b54c714b3708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf0e5fa9-ca72-4d4a-ac2d-b54c714b3708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2739616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19135fed-8abc-4952-a090-b056776abc37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c49bee974c14a7ea270d3686482d03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:34Z,use_quota=True,user_id='7dd7913f37184183add6cac66b363aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e3e4d5e-6d52-4fe2-b0bf-42fd1821e7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e3e4d5e-6d52-4fe2-b0bf-42fd1821e7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c74239-2b64-4553-bb0b-043c57260515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c74239-2b64-4553-bb0b-043c57260515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19135fed-8abc-4952-a090-b056776abc37', 'volume_name': 'volume-19135fed-8abc-4952-a090-b056776abc37', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4edac360-bf19-4e8f-9c2e-56d5dbc23a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4edac360-bf19-4e8f-9c2e-56d5dbc23a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83a498a8-6fd6-4d7c-b95d-6574619eeb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:34 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Volume 19135fed-8abc-4952-a090-b056776abc37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19135fed-8abc-4952-a090-b056776abc37', 'volume_size': 1} Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2739616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19135fed-8abc-4952-a090-b056776abc37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c49bee974c14a7ea270d3686482d03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:34Z,use_quota=True,user_id='7dd7913f37184183add6cac66b363aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Creating volume 19135fed-8abc-4952-a090-b056776abc37 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:34 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-19135fed-8abc-4952-a090-b056776abc37 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:34 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-19135fed-8abc-4952-a090-b056776abc37 1073741824 Nov 04 19:03:34 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-275daacc-e6f7-41fb-a8fe-2e82f18ac2bc tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Flow 'volume_create_manager' (8086916d-885b-4ea9-a880-dd4be72b68f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738623bb-93be-449b-8347-9204ac97bf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738623bb-93be-449b-8347-9204ac97bf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1261570790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5a31a0b-0f98-42b5-99fb-0df1553e4921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c49bee974c14a7ea270d3686482d03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:34Z,use_quota=True,user_id='7dd7913f37184183add6cac66b363aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa9995e1-9433-4d23-bf8a-5979530a2103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa9995e1-9433-4d23-bf8a-5979530a2103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9facbd6a-573d-404a-a9f7-b190d5d0aa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9facbd6a-573d-404a-a9f7-b190d5d0aa6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5a31a0b-0f98-42b5-99fb-0df1553e4921', 'volume_name': 'volume-a5a31a0b-0f98-42b5-99fb-0df1553e4921', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab087b3-4771-4e32-9f0e-3be0bc9095db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab087b3-4771-4e32-9f0e-3be0bc9095db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f2e2fca-97ba-4fb4-835d-25344d18b380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:34 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Volume a5a31a0b-0f98-42b5-99fb-0df1553e4921: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5a31a0b-0f98-42b5-99fb-0df1553e4921', 'volume_size': 1} Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:34 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-19135fed-8abc-4952-a090-b056776abc37 1073741824" returned: 0 in 0.666s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-19135fed-8abc-4952-a090-b056776abc37 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:34 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-19135fed-8abc-4952-a090-b056776abc37 Nov 04 19:03:34 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:35 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Flow 'volume_create_manager' (79272bc5-1b3c-4832-ba00-a9fe16d038f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7670ae35-c3db-4bfa-bb19-1713fb653265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-19135fed-8abc-4952-a090-b056776abc37" returned: 0 in 0.338s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-275daacc-e6f7-41fb-a8fe-2e82f18ac2bc tempest-VolumesDeleteCascade-1472720059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.574s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83a498a8-6fd6-4d7c-b95d-6574619eeb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19135fed-8abc-4952-a090-b056776abc37', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dbb761a-3f81-4238-8bf7-953e2dc0ecba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-275daacc-e6f7-41fb-a8fe-2e82f18ac2bc tempest-VolumesDeleteCascade-1472720059 None] Creating offline snapshot 030b7f9f-462b-4441-a2b0-c6d892e032fb of volume 3e2ea922-6493-405f-a9bc-a45d7947042d {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7670ae35-c3db-4bfa-bb19-1713fb653265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1838296411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d6607e3-e697-4833-920e-9632b04c4ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c49bee974c14a7ea270d3686482d03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:35Z,use_quota=True,user_id='7dd7913f37184183add6cac66b363aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24290169-246f-478d-99ef-dd7a328f48f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24290169-246f-478d-99ef-dd7a328f48f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46284c07-c578-4094-98ff-50f80f56b144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46284c07-c578-4094-98ff-50f80f56b144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d6607e3-e697-4833-920e-9632b04c4ca3', 'volume_name': 'volume-2d6607e3-e697-4833-920e-9632b04c4ca3', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22be8b1a-0b0e-4ca2-b378-16caa0154362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22be8b1a-0b0e-4ca2-b378-16caa0154362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a554dac5-f94a-447d-b3fa-c306dbba8f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:35 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Volume 2d6607e3-e697-4833-920e-9632b04c4ca3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d6607e3-e697-4833-920e-9632b04c4ca3', 'volume_size': 1} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be3b84f-04c4-4ff1-9f5a-f57889806ed3]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-275daacc-e6f7-41fb-a8fe-2e82f18ac2bc tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:35 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Volume volume-19135fed-8abc-4952-a090-b056776abc37 (19135fed-8abc-4952-a090-b056776abc37): created successfully Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dbb761a-3f81-4238-8bf7-953e2dc0ecba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Flow 'volume_create_manager' (3eaa0c99-4f85-4a0c-b6f6-72e6a449c5ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:35 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-add6be37-7df7-4087-b199-78318053e340 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Created volume successfully. Nov 04 19:03:35 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d Nov 04 19:03:35 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Flow 'volume_create_manager' (09eff71f-3776-4cf7-af41-1b30c0857f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec6cb556-7d5a-4a7a-bd7e-d9b5bd34820f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec6cb556-7d5a-4a7a-bd7e-d9b5bd34820f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-49669121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c5758f5-afeb-4a9b-aca1-9c3dd7af978f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c49bee974c14a7ea270d3686482d03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:35Z,use_quota=True,user_id='7dd7913f37184183add6cac66b363aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce6fb52-576d-4c0d-93fb-7d7a8bed259a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce6fb52-576d-4c0d-93fb-7d7a8bed259a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842c409f-b84a-42e2-bfbc-b812b757999a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842c409f-b84a-42e2-bfbc-b812b757999a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c5758f5-afeb-4a9b-aca1-9c3dd7af978f', 'volume_name': 'volume-7c5758f5-afeb-4a9b-aca1-9c3dd7af978f', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e444e4-e9a1-45be-9dab-e222418daccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e444e4-e9a1-45be-9dab-e222418daccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443f3fe8-000e-4448-9081-8b71e446b0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:35 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Volume 7c5758f5-afeb-4a9b-aca1-9c3dd7af978f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c5758f5-afeb-4a9b-aca1-9c3dd7af978f', 'volume_size': 1} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:35 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-275daacc-e6f7-41fb-a8fe-2e82f18ac2bc tempest-VolumesDeleteCascade-1472720059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d" returned: 0 in 0.550s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-275daacc-e6f7-41fb-a8fe-2e82f18ac2bc tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:35 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb 1G Nov 04 19:03:35 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Flow 'volume_create_manager' (07b4a6ae-141f-414c-b6cc-303cd15541be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fa95624-6f1d-4c5c-8bb5-8612c4571a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fa95624-6f1d-4c5c-8bb5-8612c4571a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1337008848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ece8666-0e15-40cf-9cfc-f587d791006e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c49bee974c14a7ea270d3686482d03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:36Z,use_quota=True,user_id='7dd7913f37184183add6cac66b363aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb84119-0a23-4650-bf95-0aa6d6b742d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb84119-0a23-4650-bf95-0aa6d6b742d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (156d1e3a-3aaf-4ad3-8a19-ab673088a1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (156d1e3a-3aaf-4ad3-8a19-ab673088a1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ece8666-0e15-40cf-9cfc-f587d791006e', 'volume_name': 'volume-7ece8666-0e15-40cf-9cfc-f587d791006e', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c573fb4c-c6e2-4c9c-9838-5e61d1fc53d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c573fb4c-c6e2-4c9c-9838-5e61d1fc53d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65313875-b318-4e79-851b-b4bbd6a6b50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:36 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Volume 7ece8666-0e15-40cf-9cfc-f587d791006e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ece8666-0e15-40cf-9cfc-f587d791006e', 'volume_size': 1} Nov 04 19:03:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:36 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-275daacc-e6f7-41fb-a8fe-2e82f18ac2bc tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb 1G" returned: 0 in 0.433s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-275daacc-e6f7-41fb-a8fe-2e82f18ac2bc tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e2ea922-6493-405f-a9bc-a45d7947042d -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:36 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e2ea922-6493-405f-a9bc-a45d7947042d -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb Nov 04 19:03:36 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:36 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-275daacc-e6f7-41fb-a8fe-2e82f18ac2bc tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e2ea922-6493-405f-a9bc-a45d7947042d -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb" returned: 0 in 0.306s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:36 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-275daacc-e6f7-41fb-a8fe-2e82f18ac2bc tempest-VolumesDeleteCascade-1472720059 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb is being set with open permissions: ugo+rw Nov 04 19:03:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-275daacc-e6f7-41fb-a8fe-2e82f18ac2bc tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:36 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb Nov 04 19:03:36 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:36 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-275daacc-e6f7-41fb-a8fe-2e82f18ac2bc tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb" returned: 0 in 0.263s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-275daacc-e6f7-41fb-a8fe-2e82f18ac2bc tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:36 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.info Nov 04 19:03:36 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:37 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-275daacc-e6f7-41fb-a8fe-2e82f18ac2bc tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.info" returned: 0 in 0.280s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:37 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-275daacc-e6f7-41fb-a8fe-2e82f18ac2bc tempest-VolumesDeleteCascade-1472720059 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.info is being set with open permissions: ugo+rw Nov 04 19:03:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-275daacc-e6f7-41fb-a8fe-2e82f18ac2bc tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:37 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.info Nov 04 19:03:37 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:37 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-275daacc-e6f7-41fb-a8fe-2e82f18ac2bc tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.info" returned: 0 in 0.242s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-275daacc-e6f7-41fb-a8fe-2e82f18ac2bc tempest-VolumesDeleteCascade-1472720059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.235s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.716s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1261570790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5a31a0b-0f98-42b5-99fb-0df1553e4921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c49bee974c14a7ea270d3686482d03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:34Z,use_quota=True,user_id='7dd7913f37184183add6cac66b363aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Creating volume a5a31a0b-0f98-42b5-99fb-0df1553e4921 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:37 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:03:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a5a31a0b-0f98-42b5-99fb-0df1553e4921 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:37 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a5a31a0b-0f98-42b5-99fb-0df1553e4921 1073741824 Nov 04 19:03:37 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:37 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-275daacc-e6f7-41fb-a8fe-2e82f18ac2bc tempest-VolumesDeleteCascade-1472720059 None] Create snapshot completed successfully Nov 04 19:03:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-39bf1260-1663-4670-9f68-5e2d41154012 tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:37 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a5a31a0b-0f98-42b5-99fb-0df1553e4921 1073741824" returned: 0 in 0.496s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a5a31a0b-0f98-42b5-99fb-0df1553e4921 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:37 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a5a31a0b-0f98-42b5-99fb-0df1553e4921 Nov 04 19:03:37 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:38 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a5a31a0b-0f98-42b5-99fb-0df1553e4921" returned: 0 in 0.259s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.941s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1838296411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d6607e3-e697-4833-920e-9632b04c4ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c49bee974c14a7ea270d3686482d03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:35Z,use_quota=True,user_id='7dd7913f37184183add6cac66b363aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Creating volume 2d6607e3-e697-4833-920e-9632b04c4ca3 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:38 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2d6607e3-e697-4833-920e-9632b04c4ca3 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:38 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2d6607e3-e697-4833-920e-9632b04c4ca3 1073741824 Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f2e2fca-97ba-4fb4-835d-25344d18b380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5a31a0b-0f98-42b5-99fb-0df1553e4921', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:38 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e70fc10d-090c-42b8-a22e-fff0fcfe7f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:38 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Volume volume-a5a31a0b-0f98-42b5-99fb-0df1553e4921 (a5a31a0b-0f98-42b5-99fb-0df1553e4921): created successfully Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e70fc10d-090c-42b8-a22e-fff0fcfe7f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Flow 'volume_create_manager' (8086916d-885b-4ea9-a880-dd4be72b68f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:38 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-bc456470-e3af-45e3-bb48-be0068617592 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Created volume successfully. Nov 04 19:03:38 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2d6607e3-e697-4833-920e-9632b04c4ca3 1073741824" returned: 0 in 0.431s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2d6607e3-e697-4833-920e-9632b04c4ca3 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:38 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2d6607e3-e697-4833-920e-9632b04c4ca3 Nov 04 19:03:38 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:38 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2d6607e3-e697-4833-920e-9632b04c4ca3" returned: 0 in 0.262s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.294s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-49669121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c5758f5-afeb-4a9b-aca1-9c3dd7af978f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c49bee974c14a7ea270d3686482d03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:35Z,use_quota=True,user_id='7dd7913f37184183add6cac66b363aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Creating volume 7c5758f5-afeb-4a9b-aca1-9c3dd7af978f {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:38 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7c5758f5-afeb-4a9b-aca1-9c3dd7af978f 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a554dac5-f94a-447d-b3fa-c306dbba8f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d6607e3-e697-4833-920e-9632b04c4ca3', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:38 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7c5758f5-afeb-4a9b-aca1-9c3dd7af978f 1073741824 Nov 04 19:03:38 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a4e1d66-4db5-4e9c-bd6b-102b75f85c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:38 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Volume volume-2d6607e3-e697-4833-920e-9632b04c4ca3 (2d6607e3-e697-4833-920e-9632b04c4ca3): created successfully Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a4e1d66-4db5-4e9c-bd6b-102b75f85c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Flow 'volume_create_manager' (79272bc5-1b3c-4832-ba00-a9fe16d038f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:38 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e1cc8592-5438-4708-a7f6-5989edbf947b tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Created volume successfully. Nov 04 19:03:39 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7c5758f5-afeb-4a9b-aca1-9c3dd7af978f 1073741824" returned: 0 in 0.490s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7c5758f5-afeb-4a9b-aca1-9c3dd7af978f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:39 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7c5758f5-afeb-4a9b-aca1-9c3dd7af978f Nov 04 19:03:39 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:39 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7c5758f5-afeb-4a9b-aca1-9c3dd7af978f" returned: 0 in 0.249s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:39 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.623s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:39 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1337008848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ece8666-0e15-40cf-9cfc-f587d791006e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c49bee974c14a7ea270d3686482d03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:36Z,use_quota=True,user_id='7dd7913f37184183add6cac66b363aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:39 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Creating volume 7ece8666-0e15-40cf-9cfc-f587d791006e {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:39 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:39 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:39 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:39 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:03:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ece8666-0e15-40cf-9cfc-f587d791006e 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:39 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443f3fe8-000e-4448-9081-8b71e446b0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c5758f5-afeb-4a9b-aca1-9c3dd7af978f', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:39 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5047417-10bc-4a64-bf0c-6b684c3a8356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:39 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ece8666-0e15-40cf-9cfc-f587d791006e 1073741824 Nov 04 19:03:39 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:39 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Volume volume-7c5758f5-afeb-4a9b-aca1-9c3dd7af978f (7c5758f5-afeb-4a9b-aca1-9c3dd7af978f): created successfully Nov 04 19:03:39 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5047417-10bc-4a64-bf0c-6b684c3a8356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:39 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Flow 'volume_create_manager' (09eff71f-3776-4cf7-af41-1b30c0857f82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:39 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-2deaa01e-5c41-42f7-b143-9add63a9e379 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Created volume successfully. Nov 04 19:03:40 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ece8666-0e15-40cf-9cfc-f587d791006e 1073741824" returned: 0 in 0.393s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ece8666-0e15-40cf-9cfc-f587d791006e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:40 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ece8666-0e15-40cf-9cfc-f587d791006e Nov 04 19:03:40 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:40 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ece8666-0e15-40cf-9cfc-f587d791006e" returned: 0 in 0.245s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:40 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-39bf1260-1663-4670-9f68-5e2d41154012 tempest-VolumesDeleteCascade-1472720059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.626s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:40 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-39bf1260-1663-4670-9f68-5e2d41154012 tempest-VolumesDeleteCascade-1472720059 None] Creating offline snapshot a09859a9-d963-4c7c-8831-d205c81d891a of volume 3e2ea922-6493-405f-a9bc-a45d7947042d {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:03:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65313875-b318-4e79-851b-b4bbd6a6b50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ece8666-0e15-40cf-9cfc-f587d791006e', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aec67c8c-9d2b-4f18-8662-665cf5763353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:40 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e093f05d-5b40-4aaa-8944-6918ed063288]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-39bf1260-1663-4670-9f68-5e2d41154012 tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:40 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Volume volume-7ece8666-0e15-40cf-9cfc-f587d791006e (7ece8666-0e15-40cf-9cfc-f587d791006e): created successfully Nov 04 19:03:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aec67c8c-9d2b-4f18-8662-665cf5763353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Flow 'volume_create_manager' (07b4a6ae-141f-414c-b6cc-303cd15541be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:40 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-262197aa-beeb-4c8b-bf43-82eb067ae8fd tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Created volume successfully. Nov 04 19:03:40 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb Nov 04 19:03:40 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:40 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-39bf1260-1663-4670-9f68-5e2d41154012 tempest-VolumesDeleteCascade-1472720059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb" returned: 0 in 0.347s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:40 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-39bf1260-1663-4670-9f68-5e2d41154012 tempest-VolumesDeleteCascade-1472720059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e2ea922-6493-405f-a9bc-a45d7947042d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:03:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-39bf1260-1663-4670-9f68-5e2d41154012 tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.a09859a9-d963-4c7c-8831-d205c81d891a 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:40 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.a09859a9-d963-4c7c-8831-d205c81d891a 1G Nov 04 19:03:40 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:41 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-39bf1260-1663-4670-9f68-5e2d41154012 tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.a09859a9-d963-4c7c-8831-d205c81d891a 1G" returned: 0 in 0.398s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-39bf1260-1663-4670-9f68-5e2d41154012 tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.a09859a9-d963-4c7c-8831-d205c81d891a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:41 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.a09859a9-d963-4c7c-8831-d205c81d891a Nov 04 19:03:41 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:41 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-090265b7-5dc2-4451-83bd-3f4b1bfff257 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "cinder-7ece8666-0e15-40cf-9cfc-f587d791006e-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:41 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-090265b7-5dc2-4451-83bd-3f4b1bfff257 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "cinder-7ece8666-0e15-40cf-9cfc-f587d791006e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:41 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-090265b7-5dc2-4451-83bd-3f4b1bfff257 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "cinder-quobyte-7ece8666-0e15-40cf-9cfc-f587d791006e" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:41 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-090265b7-5dc2-4451-83bd-3f4b1bfff257 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "cinder-quobyte-7ece8666-0e15-40cf-9cfc-f587d791006e" acquired by "delete_volume" :: waited 0.018s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:41 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-39bf1260-1663-4670-9f68-5e2d41154012 tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.a09859a9-d963-4c7c-8831-d205c81d891a" returned: 0 in 0.317s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:41 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-39bf1260-1663-4670-9f68-5e2d41154012 tempest-VolumesDeleteCascade-1472720059 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.a09859a9-d963-4c7c-8831-d205c81d891a is being set with open permissions: ugo+rw Nov 04 19:03:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-39bf1260-1663-4670-9f68-5e2d41154012 tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.a09859a9-d963-4c7c-8831-d205c81d891a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:41 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5736b8-fb37-445c-b05f-119373ddc39d]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-090265b7-5dc2-4451-83bd-3f4b1bfff257 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ece8666-0e15-40cf-9cfc-f587d791006e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:41 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.a09859a9-d963-4c7c-8831-d205c81d891a Nov 04 19:03:41 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:41 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ece8666-0e15-40cf-9cfc-f587d791006e Nov 04 19:03:41 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:41 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-39bf1260-1663-4670-9f68-5e2d41154012 tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.a09859a9-d963-4c7c-8831-d205c81d891a" returned: 0 in 0.235s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-39bf1260-1663-4670-9f68-5e2d41154012 tempest-VolumesDeleteCascade-1472720059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.405s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:41 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-39bf1260-1663-4670-9f68-5e2d41154012 tempest-VolumesDeleteCascade-1472720059 None] Create snapshot completed successfully Nov 04 19:03:41 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-090265b7-5dc2-4451-83bd-3f4b1bfff257 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ece8666-0e15-40cf-9cfc-f587d791006e" returned: 0 in 0.388s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-090265b7-5dc2-4451-83bd-3f4b1bfff257 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ece8666-0e15-40cf-9cfc-f587d791006e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:41 devstack sudo[105065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ece8666-0e15-40cf-9cfc-f587d791006e Nov 04 19:03:41 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:41 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "cinder-3e2ea922-6493-405f-a9bc-a45d7947042d-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:41 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-3e2ea922-6493-405f-a9bc-a45d7947042d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Performing cascade delete. {{(pid=87119) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "cinder-030b7f9f-462b-4441-a2b0-c6d892e032fb-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-030b7f9f-462b-4441-a2b0-c6d892e032fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "cinder-quobyte-3e2ea922-6493-405f-a9bc-a45d7947042d" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-quobyte-3e2ea922-6493-405f-a9bc-a45d7947042d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "cinder-quobyte-030b7f9f-462b-4441-a2b0-c6d892e032fb" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-quobyte-030b7f9f-462b-4441-a2b0-c6d892e032fb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Deleting offline snapshot 030b7f9f-462b-4441-a2b0-c6d892e032fb of volume 3e2ea922-6493-405f-a9bc-a45d7947042d {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] snapshot_file for this snap is: volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f63e96-c979-425c-9160-7c0cac49771f]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:42 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-090265b7-5dc2-4451-83bd-3f4b1bfff257 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ece8666-0e15-40cf-9cfc-f587d791006e" returned: 0 in 0.274s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-090265b7-5dc2-4451-83bd-3f4b1bfff257 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "cinder-quobyte-7ece8666-0e15-40cf-9cfc-f587d791006e" released by "delete_volume" :: held 0.708s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-090265b7-5dc2-4451-83bd-3f4b1bfff257 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Created reservations ['a636cbef-c432-4116-9d05-03eadfa7f597', '7db3985b-e36a-46b4-89b7-96122b9de873', '72c8ccf5-bcd3-4b81-84e6-29ce507bb52b', '306c3bc5-cac4-449c-bc6f-ea6669d2a48d'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:42 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb Nov 04 19:03:42 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-090265b7-5dc2-4451-83bd-3f4b1bfff257 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-090265b7-5dc2-4451-83bd-3f4b1bfff257 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-090265b7-5dc2-4451-83bd-3f4b1bfff257 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-090265b7-5dc2-4451-83bd-3f4b1bfff257 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-090265b7-5dc2-4451-83bd-3f4b1bfff257 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-090265b7-5dc2-4451-83bd-3f4b1bfff257 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:42 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:03:42 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:42 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb" returned: 0 in 0.396s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e2ea922-6493-405f-a9bc-a45d7947042d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:03:42 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3f271658-fc97-4130-8843-e2e313d577a4 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "cinder-7c5758f5-afeb-4a9b-aca1-9c3dd7af978f-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90f330f-1293-48b0-91de-9bd2111af2dd]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-090265b7-5dc2-4451-83bd-3f4b1bfff257 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.284s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-090265b7-5dc2-4451-83bd-3f4b1bfff257 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:42 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-090265b7-5dc2-4451-83bd-3f4b1bfff257 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Deleted volume successfully. Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3f271658-fc97-4130-8843-e2e313d577a4 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "cinder-7c5758f5-afeb-4a9b-aca1-9c3dd7af978f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-090265b7-5dc2-4451-83bd-3f4b1bfff257 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "cinder-7ece8666-0e15-40cf-9cfc-f587d791006e-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3f271658-fc97-4130-8843-e2e313d577a4 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "cinder-quobyte-7c5758f5-afeb-4a9b-aca1-9c3dd7af978f" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3f271658-fc97-4130-8843-e2e313d577a4 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "cinder-quobyte-7c5758f5-afeb-4a9b-aca1-9c3dd7af978f" acquired by "delete_volume" :: waited 0.015s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a2a824-5a5d-4c01-83ac-a232f583762f]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3f271658-fc97-4130-8843-e2e313d577a4 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7c5758f5-afeb-4a9b-aca1-9c3dd7af978f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:42 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d Nov 04 19:03:42 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:42 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7c5758f5-afeb-4a9b-aca1-9c3dd7af978f Nov 04 19:03:42 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:42 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d" returned: 0 in 0.401s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[112148a5-d7e4-4d99-96fe-8d2eff8174ed]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.a09859a9-d963-4c7c-8831-d205c81d891a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:43 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3f271658-fc97-4130-8843-e2e313d577a4 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7c5758f5-afeb-4a9b-aca1-9c3dd7af978f" returned: 0 in 0.378s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3f271658-fc97-4130-8843-e2e313d577a4 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7c5758f5-afeb-4a9b-aca1-9c3dd7af978f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:43 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7c5758f5-afeb-4a9b-aca1-9c3dd7af978f Nov 04 19:03:43 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:43 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.a09859a9-d963-4c7c-8831-d205c81d891a Nov 04 19:03:43 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:43 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3f271658-fc97-4130-8843-e2e313d577a4 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7c5758f5-afeb-4a9b-aca1-9c3dd7af978f" returned: 0 in 0.256s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3f271658-fc97-4130-8843-e2e313d577a4 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "cinder-quobyte-7c5758f5-afeb-4a9b-aca1-9c3dd7af978f" released by "delete_volume" :: held 0.676s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-3f271658-fc97-4130-8843-e2e313d577a4 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Created reservations ['7cfca6c2-bbd8-44d6-8350-3a64b1b7c8f4', 'd8e475f1-f38d-4095-bb00-706c24149e5b', '2aef6548-bd91-4675-b2f2-8c603d5e8d34', 'fde97369-9a59-4cee-a229-0dcc712cbca0'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:43 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.a09859a9-d963-4c7c-8831-d205c81d891a" returned: 0 in 0.389s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e2ea922-6493-405f-a9bc-a45d7947042d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd48ded-adf6-4bb5-a6f2-0ce1c6f474da]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3f271658-fc97-4130-8843-e2e313d577a4 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3f271658-fc97-4130-8843-e2e313d577a4 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3f271658-fc97-4130-8843-e2e313d577a4 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3f271658-fc97-4130-8843-e2e313d577a4 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3f271658-fc97-4130-8843-e2e313d577a4 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3f271658-fc97-4130-8843-e2e313d577a4 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:43 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:03:43 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:43 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb Nov 04 19:03:43 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:43 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-24089645-144a-44c4-8bf4-6ee275fc286f tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "cinder-2d6607e3-e697-4833-920e-9632b04c4ca3-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3f271658-fc97-4130-8843-e2e313d577a4 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.264s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-3f271658-fc97-4130-8843-e2e313d577a4 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:43 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-3f271658-fc97-4130-8843-e2e313d577a4 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Deleted volume successfully. Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-24089645-144a-44c4-8bf4-6ee275fc286f tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "cinder-2d6607e3-e697-4833-920e-9632b04c4ca3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3f271658-fc97-4130-8843-e2e313d577a4 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "cinder-7c5758f5-afeb-4a9b-aca1-9c3dd7af978f-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-24089645-144a-44c4-8bf4-6ee275fc286f tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "cinder-quobyte-2d6607e3-e697-4833-920e-9632b04c4ca3" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-24089645-144a-44c4-8bf4-6ee275fc286f tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "cinder-quobyte-2d6607e3-e697-4833-920e-9632b04c4ca3" acquired by "delete_volume" :: waited 0.016s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:43 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd550e09-1a8e-49c1-84b2-51044e7cd22a]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb" returned: 0 in 0.443s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-24089645-144a-44c4-8bf4-6ee275fc286f tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2d6607e3-e697-4833-920e-9632b04c4ca3 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e2ea922-6493-405f-a9bc-a45d7947042d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac69d392-415d-40a5-9601-c48ef1f431ff]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:43 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2d6607e3-e697-4833-920e-9632b04c4ca3 Nov 04 19:03:43 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:43 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d Nov 04 19:03:43 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:44 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-24089645-144a-44c4-8bf4-6ee275fc286f tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2d6607e3-e697-4833-920e-9632b04c4ca3" returned: 0 in 0.382s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-24089645-144a-44c4-8bf4-6ee275fc286f tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2d6607e3-e697-4833-920e-9632b04c4ca3 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:44 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d" returned: 0 in 0.371s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:44 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2d6607e3-e697-4833-920e-9632b04c4ca3 Nov 04 19:03:44 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:44 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb Nov 04 19:03:44 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:44 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-24089645-144a-44c4-8bf4-6ee275fc286f tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2d6607e3-e697-4833-920e-9632b04c4ca3" returned: 0 in 0.245s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-24089645-144a-44c4-8bf4-6ee275fc286f tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "cinder-quobyte-2d6607e3-e697-4833-920e-9632b04c4ca3" released by "delete_volume" :: held 0.672s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:44 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-24089645-144a-44c4-8bf4-6ee275fc286f tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Created reservations ['5f943cac-0fb4-4938-9c28-689dc2655042', 'aa537d10-caee-47cf-8a8a-4c2984e4d243', 'a3324ae1-f80e-4b27-9614-df1d617c2fbf', '5f5f7d70-fada-4673-a135-98eab343c68f'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:44 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb" returned: 0 in 0.348s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-24089645-144a-44c4-8bf4-6ee275fc286f tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-24089645-144a-44c4-8bf4-6ee275fc286f tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:44 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-24089645-144a-44c4-8bf4-6ee275fc286f tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:44 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb Nov 04 19:03:44 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:44 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-24089645-144a-44c4-8bf4-6ee275fc286f tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-24089645-144a-44c4-8bf4-6ee275fc286f tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-24089645-144a-44c4-8bf4-6ee275fc286f tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:44 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:03:44 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:44 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.030b7f9f-462b-4441-a2b0-c6d892e032fb" returned: 0 in 0.284s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e2ea922-6493-405f-a9bc-a45d7947042d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.a09859a9-d963-4c7c-8831-d205c81d891a -F qcow2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:44 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-24089645-144a-44c4-8bf4-6ee275fc286f tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.268s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:44 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-24089645-144a-44c4-8bf4-6ee275fc286f tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:44 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-24089645-144a-44c4-8bf4-6ee275fc286f tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Deleted volume successfully. Nov 04 19:03:44 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e2ea922-6493-405f-a9bc-a45d7947042d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.a09859a9-d963-4c7c-8831-d205c81d891a -F qcow2 Nov 04 19:03:44 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-83ba4fbe-eed1-4753-bb61-c0e7469f2978 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "cinder-a5a31a0b-0f98-42b5-99fb-0df1553e4921-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-24089645-144a-44c4-8bf4-6ee275fc286f tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "cinder-2d6607e3-e697-4833-920e-9632b04c4ca3-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-83ba4fbe-eed1-4753-bb61-c0e7469f2978 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "cinder-a5a31a0b-0f98-42b5-99fb-0df1553e4921-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-83ba4fbe-eed1-4753-bb61-c0e7469f2978 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "cinder-quobyte-a5a31a0b-0f98-42b5-99fb-0df1553e4921" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-83ba4fbe-eed1-4753-bb61-c0e7469f2978 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "cinder-quobyte-a5a31a0b-0f98-42b5-99fb-0df1553e4921" acquired by "delete_volume" :: waited 0.017s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23d51e2-25c2-4a85-8e2a-3d003568984f]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-83ba4fbe-eed1-4753-bb61-c0e7469f2978 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a5a31a0b-0f98-42b5-99fb-0df1553e4921 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:45 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a5a31a0b-0f98-42b5-99fb-0df1553e4921 Nov 04 19:03:45 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:45 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e2ea922-6493-405f-a9bc-a45d7947042d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.a09859a9-d963-4c7c-8831-d205c81d891a -F qcow2" returned: 0 in 0.322s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-quobyte-030b7f9f-462b-4441-a2b0-c6d892e032fb" released by "_delete_snapshot" :: held 3.162s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-quobyte-3e2ea922-6493-405f-a9bc-a45d7947042d" released by "delete_snapshot" :: held 3.183s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Created reservations ['9cf9223a-54ba-45a6-a06a-fe2761148a01', '9a84fae0-9dcb-4d88-8dc2-8629d3bcfd9f', 'b5e0b80f-e8b9-479e-a512-ea2a52383e06', 'd136e4eb-8521-4877-ade4-cbc066afe7d6'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:45 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Delete snapshot completed successfully. Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-030b7f9f-462b-4441-a2b0-c6d892e032fb-delete_snapshot" released by "delete_snapshot" :: held 3.338s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "cinder-a09859a9-d963-4c7c-8831-d205c81d891a-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-a09859a9-d963-4c7c-8831-d205c81d891a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "cinder-quobyte-3e2ea922-6493-405f-a9bc-a45d7947042d" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-quobyte-3e2ea922-6493-405f-a9bc-a45d7947042d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "cinder-quobyte-a09859a9-d963-4c7c-8831-d205c81d891a" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:45 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-83ba4fbe-eed1-4753-bb61-c0e7469f2978 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a5a31a0b-0f98-42b5-99fb-0df1553e4921" returned: 0 in 0.387s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-83ba4fbe-eed1-4753-bb61-c0e7469f2978 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a5a31a0b-0f98-42b5-99fb-0df1553e4921 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-quobyte-a09859a9-d963-4c7c-8831-d205c81d891a" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Deleting offline snapshot a09859a9-d963-4c7c-8831-d205c81d891a of volume 3e2ea922-6493-405f-a9bc-a45d7947042d {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:03:45 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a5a31a0b-0f98-42b5-99fb-0df1553e4921 Nov 04 19:03:45 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] snapshot_file for this snap is: volume-3e2ea922-6493-405f-a9bc-a45d7947042d.a09859a9-d963-4c7c-8831-d205c81d891a {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[62aa19e7-739a-46f9-9458-db34ea33baf4]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.a09859a9-d963-4c7c-8831-d205c81d891a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:45 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.a09859a9-d963-4c7c-8831-d205c81d891a Nov 04 19:03:45 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:45 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-83ba4fbe-eed1-4753-bb61-c0e7469f2978 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a5a31a0b-0f98-42b5-99fb-0df1553e4921" returned: 0 in 0.262s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-83ba4fbe-eed1-4753-bb61-c0e7469f2978 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "cinder-quobyte-a5a31a0b-0f98-42b5-99fb-0df1553e4921" released by "delete_volume" :: held 0.690s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-83ba4fbe-eed1-4753-bb61-c0e7469f2978 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Created reservations ['faa2dfe3-e4a7-4585-a4a8-dee6dde27695', '19cd12c3-80e0-4158-b557-b50cd045a8c0', '82709dbe-eefa-4b9b-98a2-4ba610472bd6', 'ade4c114-acad-496a-b95f-ea8422305740'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-83ba4fbe-eed1-4753-bb61-c0e7469f2978 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-83ba4fbe-eed1-4753-bb61-c0e7469f2978 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-83ba4fbe-eed1-4753-bb61-c0e7469f2978 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-83ba4fbe-eed1-4753-bb61-c0e7469f2978 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-83ba4fbe-eed1-4753-bb61-c0e7469f2978 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-83ba4fbe-eed1-4753-bb61-c0e7469f2978 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:45 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:03:45 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:45 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.a09859a9-d963-4c7c-8831-d205c81d891a" returned: 0 in 0.376s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e2ea922-6493-405f-a9bc-a45d7947042d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd8be4e-1d36-4c0a-869b-de63aff7ecf2]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:46 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d Nov 04 19:03:46 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:46 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-83ba4fbe-eed1-4753-bb61-c0e7469f2978 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.272s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:46 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-83ba4fbe-eed1-4753-bb61-c0e7469f2978 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-98a14ae2-dd63-4603-936d-3d8a81fa201c tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "cinder-19135fed-8abc-4952-a090-b056776abc37-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:46 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-83ba4fbe-eed1-4753-bb61-c0e7469f2978 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Deleted volume successfully. Nov 04 19:03:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-98a14ae2-dd63-4603-936d-3d8a81fa201c tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "cinder-19135fed-8abc-4952-a090-b056776abc37-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-83ba4fbe-eed1-4753-bb61-c0e7469f2978 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "cinder-a5a31a0b-0f98-42b5-99fb-0df1553e4921-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-98a14ae2-dd63-4603-936d-3d8a81fa201c tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "cinder-quobyte-19135fed-8abc-4952-a090-b056776abc37" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-98a14ae2-dd63-4603-936d-3d8a81fa201c tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "cinder-quobyte-19135fed-8abc-4952-a090-b056776abc37" acquired by "delete_volume" :: waited 0.017s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:46 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76ce508-fce9-43f8-9e2c-db832b37894d]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-98a14ae2-dd63-4603-936d-3d8a81fa201c tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-19135fed-8abc-4952-a090-b056776abc37 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:46 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d" returned: 0 in 0.382s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.a09859a9-d963-4c7c-8831-d205c81d891a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:46 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.a09859a9-d963-4c7c-8831-d205c81d891a Nov 04 19:03:46 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:46 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-19135fed-8abc-4952-a090-b056776abc37 Nov 04 19:03:46 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:46 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-98a14ae2-dd63-4603-936d-3d8a81fa201c tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-19135fed-8abc-4952-a090-b056776abc37" returned: 0 in 0.360s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-98a14ae2-dd63-4603-936d-3d8a81fa201c tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-19135fed-8abc-4952-a090-b056776abc37 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:46 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.a09859a9-d963-4c7c-8831-d205c81d891a" returned: 0 in 0.332s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.a09859a9-d963-4c7c-8831-d205c81d891a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:46 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-19135fed-8abc-4952-a090-b056776abc37 Nov 04 19:03:46 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:46 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.a09859a9-d963-4c7c-8831-d205c81d891a Nov 04 19:03:46 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:46 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-98a14ae2-dd63-4603-936d-3d8a81fa201c tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-19135fed-8abc-4952-a090-b056776abc37" returned: 0 in 0.265s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:46 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d.a09859a9-d963-4c7c-8831-d205c81d891a" returned: 0 in 0.269s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-98a14ae2-dd63-4603-936d-3d8a81fa201c tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "cinder-quobyte-19135fed-8abc-4952-a090-b056776abc37" released by "delete_volume" :: held 0.697s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-quobyte-a09859a9-d963-4c7c-8831-d205c81d891a" released by "_delete_snapshot" :: held 1.481s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-quobyte-3e2ea922-6493-405f-a9bc-a45d7947042d" released by "delete_snapshot" :: held 1.521s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:47 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-98a14ae2-dd63-4603-936d-3d8a81fa201c tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Created reservations ['3e36f854-7931-40f5-96e7-39a706042180', '24c692d3-1613-4b5c-bd3a-d9541ce7d37f', '3ac2c426-21a8-4ad6-88a8-ae4a70a272e2', 'f59643cb-8efa-49fc-bbc5-09877a844b6a'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:47 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Created reservations ['e6019c0c-7831-4419-b4fb-7f75e7bcae9d', 'c16d0fc9-561c-470f-95ac-19f6e80f8a38', '6c940169-0a6d-4029-80f7-6bcb9535e31d', '14d8af4e-483e-4b51-b0ae-3196347ce6c2'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-98a14ae2-dd63-4603-936d-3d8a81fa201c tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-98a14ae2-dd63-4603-936d-3d8a81fa201c tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-98a14ae2-dd63-4603-936d-3d8a81fa201c tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-98a14ae2-dd63-4603-936d-3d8a81fa201c tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-98a14ae2-dd63-4603-936d-3d8a81fa201c tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-98a14ae2-dd63-4603-936d-3d8a81fa201c tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:47 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:03:47 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:47 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Delete snapshot completed successfully. Nov 04 19:03:47 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-a09859a9-d963-4c7c-8831-d205c81d891a-delete_snapshot" released by "delete_snapshot" :: held 1.741s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Snapshots deleted, issuing volume delete {{(pid=87119) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 04 19:03:47 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "cinder-quobyte-3e2ea922-6493-405f-a9bc-a45d7947042d" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:47 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-quobyte-3e2ea922-6493-405f-a9bc-a45d7947042d" acquired by "delete_volume" :: waited 0.016s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:47 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f2786b-80fd-4e75-927a-37b35b93e481]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:47 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-254ffe51-ed0f-4f89-9f85-71eb264096f7 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "cinder-6bd5bb75-e419-482c-bc59-c54844365a0c-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:47 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-254ffe51-ed0f-4f89-9f85-71eb264096f7 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "cinder-6bd5bb75-e419-482c-bc59-c54844365a0c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:47 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d Nov 04 19:03:47 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:47 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-98a14ae2-dd63-4603-936d-3d8a81fa201c tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.342s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:47 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-98a14ae2-dd63-4603-936d-3d8a81fa201c tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:47 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-254ffe51-ed0f-4f89-9f85-71eb264096f7 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "cinder-quobyte-6bd5bb75-e419-482c-bc59-c54844365a0c" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:47 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-98a14ae2-dd63-4603-936d-3d8a81fa201c tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Deleted volume successfully. Nov 04 19:03:47 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-254ffe51-ed0f-4f89-9f85-71eb264096f7 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "cinder-quobyte-6bd5bb75-e419-482c-bc59-c54844365a0c" acquired by "delete_volume" :: waited 0.021s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:47 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-98a14ae2-dd63-4603-936d-3d8a81fa201c tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "cinder-19135fed-8abc-4952-a090-b056776abc37-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:47 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e2ef29-e4c1-414f-a473-e782a9b32389]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-254ffe51-ed0f-4f89-9f85-71eb264096f7 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6bd5bb75-e419-482c-bc59-c54844365a0c {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:47 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6bd5bb75-e419-482c-bc59-c54844365a0c Nov 04 19:03:47 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:47 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d" returned: 0 in 0.504s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:47 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d Nov 04 19:03:47 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:47 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-254ffe51-ed0f-4f89-9f85-71eb264096f7 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6bd5bb75-e419-482c-bc59-c54844365a0c" returned: 0 in 0.413s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-254ffe51-ed0f-4f89-9f85-71eb264096f7 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6bd5bb75-e419-482c-bc59-c54844365a0c {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:47 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6bd5bb75-e419-482c-bc59-c54844365a0c Nov 04 19:03:47 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:48 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3e2ea922-6493-405f-a9bc-a45d7947042d" returned: 0 in 0.282s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-quobyte-3e2ea922-6493-405f-a9bc-a45d7947042d" released by "delete_volume" :: held 0.871s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:48 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Created reservations ['eca14365-7aac-4ca8-a922-f0d612179f87', 'cd91baa5-21b0-49eb-9893-a649700a945a', '3cfb29a4-8395-4b12-9fd4-6645e2dd1479', 'd37d252f-14b8-4546-ad8c-8171ec70ff92'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:48 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-254ffe51-ed0f-4f89-9f85-71eb264096f7 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6bd5bb75-e419-482c-bc59-c54844365a0c" returned: 0 in 0.284s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:48 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:03:48 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-254ffe51-ed0f-4f89-9f85-71eb264096f7 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "cinder-quobyte-6bd5bb75-e419-482c-bc59-c54844365a0c" released by "delete_volume" :: held 0.750s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:48 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-254ffe51-ed0f-4f89-9f85-71eb264096f7 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Created reservations ['94a1f4d7-57df-4400-951e-5b41da36efd5', '2ebafdc7-8a9e-40cd-aef0-9370af1e5e23', '1a8e89cf-9275-4384-bddc-fb71b898b176', '466ceb06-5038-437b-9f27-a26356115999'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-254ffe51-ed0f-4f89-9f85-71eb264096f7 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-254ffe51-ed0f-4f89-9f85-71eb264096f7 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-254ffe51-ed0f-4f89-9f85-71eb264096f7 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-254ffe51-ed0f-4f89-9f85-71eb264096f7 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-254ffe51-ed0f-4f89-9f85-71eb264096f7 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-254ffe51-ed0f-4f89-9f85-71eb264096f7 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:48 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:03:48 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:48 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.259s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:48 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:48 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Deleted volume successfully. Nov 04 19:03:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5d4d47ac-4f9f-4a5b-8a7f-9aa23ff275cf tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-3e2ea922-6493-405f-a9bc-a45d7947042d-delete_volume" released by "delete_volume" :: held 6.511s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:48 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-254ffe51-ed0f-4f89-9f85-71eb264096f7 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.311s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:48 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-254ffe51-ed0f-4f89-9f85-71eb264096f7 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:48 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-254ffe51-ed0f-4f89-9f85-71eb264096f7 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Deleted volume successfully. Nov 04 19:03:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-254ffe51-ed0f-4f89-9f85-71eb264096f7 tempest-CreateVolumesFromSourceVolumeTest-1033999085 None] Lock "cinder-6bd5bb75-e419-482c-bc59-c54844365a0c-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:49 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:49 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Flow 'volume_create_manager' (cc415cb5-980d-47eb-abe5-474bf7a4fdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:49 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5dee7dc-b920-4142-9f72-62de63c0e022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:49 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5dee7dc-b920-4142-9f72-62de63c0e022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1041387766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38bc83e8-1342-4844-be84-e86e83ea60b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17f3acfa1184e199eff21b1255e6e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:49Z,use_quota=True,user_id='594ba10518fc4bab8279ff555530de21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:49 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09723f38-824f-4e57-9c84-c5e45b644627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:49 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09723f38-824f-4e57-9c84-c5e45b644627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:49 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4930c3f6-25c1-4825-9482-f706a27e8364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:49 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4930c3f6-25c1-4825-9482-f706a27e8364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38bc83e8-1342-4844-be84-e86e83ea60b6', 'volume_name': 'volume-38bc83e8-1342-4844-be84-e86e83ea60b6', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:49 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090729b4-003a-4d28-80c2-c86bd669e295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:49 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090729b4-003a-4d28-80c2-c86bd669e295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:49 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be1b7703-2243-4156-933d-fdeae35ca608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:49 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Volume 38bc83e8-1342-4844-be84-e86e83ea60b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38bc83e8-1342-4844-be84-e86e83ea60b6', 'volume_size': 1} Nov 04 19:03:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:49 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1041387766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38bc83e8-1342-4844-be84-e86e83ea60b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17f3acfa1184e199eff21b1255e6e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:49Z,use_quota=True,user_id='594ba10518fc4bab8279ff555530de21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:49 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Creating volume 38bc83e8-1342-4844-be84-e86e83ea60b6 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:49 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:49 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:49 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:49 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:03:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:49 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6 1073741824 Nov 04 19:03:49 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:49 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6 1073741824" returned: 0 in 0.472s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:49 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6 Nov 04 19:03:49 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:50 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6" returned: 0 in 0.260s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:50 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:50 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be1b7703-2243-4156-933d-fdeae35ca608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38bc83e8-1342-4844-be84-e86e83ea60b6', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:50 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9b5fd5-b41c-4234-a701-b54383d5ef2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:50 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Volume volume-38bc83e8-1342-4844-be84-e86e83ea60b6 (38bc83e8-1342-4844-be84-e86e83ea60b6): created successfully Nov 04 19:03:50 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9b5fd5-b41c-4234-a701-b54383d5ef2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:50 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Flow 'volume_create_manager' (cc415cb5-980d-47eb-abe5-474bf7a4fdcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:50 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-9942c452-519b-4a16-9a05-4c7318e7e343 tempest-VolumesDeleteCascade-1472720059 None] Created volume successfully. Nov 04 19:03:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8b827b38-85fe-4a5f-9c06-01825be0cd9c tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8b827b38-85fe-4a5f-9c06-01825be0cd9c tempest-VolumesDeleteCascade-1472720059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:51 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:51 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Flow 'volume_create_manager' (4ea70a72-b75e-49d7-839c-fd260a004059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:51 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e43195-ffb5-4360-8259-586c4605d9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:51 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-8b827b38-85fe-4a5f-9c06-01825be0cd9c tempest-VolumesDeleteCascade-1472720059 None] Creating offline snapshot 4663a82e-5d6d-4a55-9813-3c99b476b05c of volume 38bc83e8-1342-4844-be84-e86e83ea60b6 {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:03:51 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e43195-ffb5-4360-8259-586c4605d9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=449c5323-91b8-44b3-9f07-7f090a9a8497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da665bed9b3e4c0eaa2f4640508d30fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:52Z,use_quota=True,user_id='bcd2014f8cfa40f782fbb755722d4881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:51 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6678a092-47f3-4a18-b509-fcfc110e5a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:51 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6678a092-47f3-4a18-b509-fcfc110e5a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:51 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a144eee9-8692-41c6-b53c-9895093bc643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:51 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a144eee9-8692-41c6-b53c-9895093bc643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '449c5323-91b8-44b3-9f07-7f090a9a8497', 'volume_name': 'volume-449c5323-91b8-44b3-9f07-7f090a9a8497', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:51 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d35be6-0927-4160-8d7e-cf22a269cf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:51 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d35be6-0927-4160-8d7e-cf22a269cf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:51 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (433adcec-f77e-4d20-84b4-94a747e86583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:51 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Volume 449c5323-91b8-44b3-9f07-7f090a9a8497: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-449c5323-91b8-44b3-9f07-7f090a9a8497', 'volume_size': 1} Nov 04 19:03:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:51 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda42e97-c262-4e26-a969-9d20d4fd8ba9]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8b827b38-85fe-4a5f-9c06-01825be0cd9c tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:51 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6 Nov 04 19:03:51 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:52 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8b827b38-85fe-4a5f-9c06-01825be0cd9c tempest-VolumesDeleteCascade-1472720059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6" returned: 0 in 0.375s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8b827b38-85fe-4a5f-9c06-01825be0cd9c tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.4663a82e-5d6d-4a55-9813-3c99b476b05c 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:52 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.4663a82e-5d6d-4a55-9813-3c99b476b05c 1G Nov 04 19:03:52 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:52 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8b827b38-85fe-4a5f-9c06-01825be0cd9c tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.4663a82e-5d6d-4a55-9813-3c99b476b05c 1G" returned: 0 in 0.414s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8b827b38-85fe-4a5f-9c06-01825be0cd9c tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38bc83e8-1342-4844-be84-e86e83ea60b6 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.4663a82e-5d6d-4a55-9813-3c99b476b05c {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:52 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38bc83e8-1342-4844-be84-e86e83ea60b6 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.4663a82e-5d6d-4a55-9813-3c99b476b05c Nov 04 19:03:52 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:52 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8b827b38-85fe-4a5f-9c06-01825be0cd9c tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38bc83e8-1342-4844-be84-e86e83ea60b6 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.4663a82e-5d6d-4a55-9813-3c99b476b05c" returned: 0 in 0.288s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:52 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-8b827b38-85fe-4a5f-9c06-01825be0cd9c tempest-VolumesDeleteCascade-1472720059 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.4663a82e-5d6d-4a55-9813-3c99b476b05c is being set with open permissions: ugo+rw Nov 04 19:03:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8b827b38-85fe-4a5f-9c06-01825be0cd9c tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.4663a82e-5d6d-4a55-9813-3c99b476b05c {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:52 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.4663a82e-5d6d-4a55-9813-3c99b476b05c Nov 04 19:03:52 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:53 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8b827b38-85fe-4a5f-9c06-01825be0cd9c tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.4663a82e-5d6d-4a55-9813-3c99b476b05c" returned: 0 in 0.260s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8b827b38-85fe-4a5f-9c06-01825be0cd9c tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:53 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.info Nov 04 19:03:53 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:53 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8b827b38-85fe-4a5f-9c06-01825be0cd9c tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.info" returned: 0 in 0.249s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:53 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-8b827b38-85fe-4a5f-9c06-01825be0cd9c tempest-VolumesDeleteCascade-1472720059 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.info is being set with open permissions: ugo+rw Nov 04 19:03:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8b827b38-85fe-4a5f-9c06-01825be0cd9c tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:53 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.info Nov 04 19:03:53 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:53 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8b827b38-85fe-4a5f-9c06-01825be0cd9c tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.info" returned: 0 in 0.267s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8b827b38-85fe-4a5f-9c06-01825be0cd9c tempest-VolumesDeleteCascade-1472720059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.016s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.919s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:53 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=449c5323-91b8-44b3-9f07-7f090a9a8497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da665bed9b3e4c0eaa2f4640508d30fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:52Z,use_quota=True,user_id='bcd2014f8cfa40f782fbb755722d4881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:53 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Creating volume 449c5323-91b8-44b3-9f07-7f090a9a8497 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:53 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:53 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:53 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:53 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:03:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-449c5323-91b8-44b3-9f07-7f090a9a8497 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:53 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-449c5323-91b8-44b3-9f07-7f090a9a8497 1073741824 Nov 04 19:03:53 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:53 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-8b827b38-85fe-4a5f-9c06-01825be0cd9c tempest-VolumesDeleteCascade-1472720059 None] Create snapshot completed successfully Nov 04 19:03:54 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-449c5323-91b8-44b3-9f07-7f090a9a8497 1073741824" returned: 0 in 0.426s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-449c5323-91b8-44b3-9f07-7f090a9a8497 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:54 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-449c5323-91b8-44b3-9f07-7f090a9a8497 Nov 04 19:03:54 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:54 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-449c5323-91b8-44b3-9f07-7f090a9a8497" returned: 0 in 0.243s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:54 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:54 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (433adcec-f77e-4d20-84b4-94a747e86583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-449c5323-91b8-44b3-9f07-7f090a9a8497', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:54 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb73af7d-7e33-499e-9fab-1d5a4ed230a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:54 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Volume volume-449c5323-91b8-44b3-9f07-7f090a9a8497 (449c5323-91b8-44b3-9f07-7f090a9a8497): created successfully Nov 04 19:03:54 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb73af7d-7e33-499e-9fab-1d5a4ed230a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:54 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Flow 'volume_create_manager' (4ea70a72-b75e-49d7-839c-fd260a004059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:54 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-c757fd3e-86b1-45c9-94fc-9c15f10a6eb9 tempest-CinderUnicodeTest-444046007 None] Created volume successfully. Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Flow 'volume_create_manager' (a2956701-414c-4304-b5f7-72ffaacc0fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae292d6-e0b4-4291-a9fd-319c881076cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae292d6-e0b4-4291-a9fd-319c881076cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1609303958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aaaa102-8071-4baf-bd8b-c7af2cda38c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17f3acfa1184e199eff21b1255e6e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4663a82e-5d6d-4a55-9813-3c99b476b05c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:55Z,use_quota=True,user_id='594ba10518fc4bab8279ff555530de21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb98dab9-c40c-4772-a831-772b7823b3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb98dab9-c40c-4772-a831-772b7823b3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d6a85a-d7f1-48a9-a05e-5e4687b8972c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d6a85a-d7f1-48a9-a05e-5e4687b8972c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7aaaa102-8071-4baf-bd8b-c7af2cda38c4', 'volume_name': 'volume-7aaaa102-8071-4baf-bd8b-c7af2cda38c4', 'volume_size': 1, 'snapshot_id': '4663a82e-5d6d-4a55-9813-3c99b476b05c'}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b113526-3959-46e6-8f9e-804a721ee6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b113526-3959-46e6-8f9e-804a721ee6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b73a17fb-27a9-4316-852e-eadea7617d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:55 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Volume 7aaaa102-8071-4baf-bd8b-c7af2cda38c4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7aaaa102-8071-4baf-bd8b-c7af2cda38c4', 'volume_size': 1, 'snapshot_id': '4663a82e-5d6d-4a55-9813-3c99b476b05c'} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "cinder-quobyte-4663a82e-5d6d-4a55-9813-3c99b476b05c-7aaaa102-8071-4baf-bd8b-c7af2cda38c4" by "_create_volume_from_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Flow 'volume_create_manager' (25a12bd2-0364-40f6-b544-bd27be460a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b067841d-d34a-4498-ac13-c4e483f202b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-quobyte-4663a82e-5d6d-4a55-9813-3c99b476b05c-7aaaa102-8071-4baf-bd8b-c7af2cda38c4" acquired by "_create_volume_from_snapshot" :: waited 0.055s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Creating volume 7aaaa102-8071-4baf-bd8b-c7af2cda38c4 from snapshot 4663a82e-5d6d-4a55-9813-3c99b476b05c {{(pid=87119) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "cinder-quobyte-7aaaa102-8071-4baf-bd8b-c7af2cda38c4" by "_copy_volume_from_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b067841d-d34a-4498-ac13-c4e483f202b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1021711628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a99845a-f96c-467a-9473-da87ca450eac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da665bed9b3e4c0eaa2f4640508d30fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:55Z,use_quota=True,user_id='bcd2014f8cfa40f782fbb755722d4881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bc197ba-eb5f-470b-9fc3-69b425f15cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bc197ba-eb5f-470b-9fc3-69b425f15cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65a2b27d-4b62-4758-941e-68bb31685ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65a2b27d-4b62-4758-941e-68bb31685ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a99845a-f96c-467a-9473-da87ca450eac', 'volume_name': 'volume-3a99845a-f96c-467a-9473-da87ca450eac', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865f02b1-29ad-47b8-ac6a-506a1baf3c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865f02b1-29ad-47b8-ac6a-506a1baf3c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1495e4-e0e2-4e73-9120-a31ae873cb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:55 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Volume 3a99845a-f96c-467a-9473-da87ca450eac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a99845a-f96c-467a-9473-da87ca450eac', 'volume_size': 1} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-quobyte-7aaaa102-8071-4baf-bd8b-c7af2cda38c4" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] snapshot: 4663a82e-5d6d-4a55-9813-3c99b476b05c, volume: 7aaaa102-8071-4baf-bd8b-c7af2cda38c4, {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94e01e5-c590-4574-9d12-e35f0cc9fa6b]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.4663a82e-5d6d-4a55-9813-3c99b476b05c {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:55 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.4663a82e-5d6d-4a55-9813-3c99b476b05c Nov 04 19:03:55 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:55 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.4663a82e-5d6d-4a55-9813-3c99b476b05c" returned: 0 in 0.371s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:55 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38bc83e8-1342-4844-be84-e86e83ea60b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:03:56 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de28c9a-365e-4f2b-b7f6-ff6b41415da4]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:56 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6 Nov 04 19:03:56 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:56 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6" returned: 0 in 0.364s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:56 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6 {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:03:56 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Creating direct copy from snapshot {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:03:56 devstack cinder-volume[87119]: DEBUG cinder.utils [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Path /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7aaaa102-8071-4baf-bd8b-c7af2cda38c4 not found in is_blk_device check {{(pid=87119) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:03:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7aaaa102-8071-4baf-bd8b-c7af2cda38c4 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:56 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7aaaa102-8071-4baf-bd8b-c7af2cda38c4 Nov 04 19:03:56 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:02 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7aaaa102-8071-4baf-bd8b-c7af2cda38c4" returned: 0 in 5.665s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:02 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Image conversion details: src /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6, size 1024.00 MB, duration 5.67 sec, destination /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7aaaa102-8071-4baf-bd8b-c7af2cda38c4 {{(pid=87119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:04:02 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Converted 1024.00 MB image at 180.72 MB/s Nov 04 19:04:02 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7aaaa102-8071-4baf-bd8b-c7af2cda38c4 is being set with open permissions: ugo+rw Nov 04 19:04:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7aaaa102-8071-4baf-bd8b-c7af2cda38c4 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:02 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7aaaa102-8071-4baf-bd8b-c7af2cda38c4 Nov 04 19:04:02 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:02 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7aaaa102-8071-4baf-bd8b-c7af2cda38c4" returned: 0 in 0.244s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:02 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-quobyte-7aaaa102-8071-4baf-bd8b-c7af2cda38c4" released by "_copy_volume_from_snapshot" :: held 6.731s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:02 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-quobyte-4663a82e-5d6d-4a55-9813-3c99b476b05c-7aaaa102-8071-4baf-bd8b-c7af2cda38c4" released by "_create_volume_from_snapshot" :: held 6.832s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.889s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.783s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1021711628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a99845a-f96c-467a-9473-da87ca450eac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da665bed9b3e4c0eaa2f4640508d30fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:55Z,use_quota=True,user_id='bcd2014f8cfa40f782fbb755722d4881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:04:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Creating volume 3a99845a-f96c-467a-9473-da87ca450eac {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:04:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:04:02 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:04:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:02 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac 1073741824 Nov 04 19:04:02 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b73a17fb-27a9-4316-852e-eadea7617d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aaaa102-8071-4baf-bd8b-c7af2cda38c4', 'volume_size': 1, 'snapshot_id': '4663a82e-5d6d-4a55-9813-3c99b476b05c'}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3288d6-aa21-4626-946d-80c430200ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:02 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Volume volume-7aaaa102-8071-4baf-bd8b-c7af2cda38c4 (7aaaa102-8071-4baf-bd8b-c7af2cda38c4): created successfully Nov 04 19:04:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3288d6-aa21-4626-946d-80c430200ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Flow 'volume_create_manager' (a2956701-414c-4304-b5f7-72ffaacc0fc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:02 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-eebd7859-2137-4838-a812-0a0c9bff919f tempest-VolumesDeleteCascade-1472720059 None] Created volume successfully. Nov 04 19:04:02 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "cinder-38bc83e8-1342-4844-be84-e86e83ea60b6-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:02 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-38bc83e8-1342-4844-be84-e86e83ea60b6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Performing cascade delete. {{(pid=87119) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 04 19:04:02 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac 1073741824" returned: 0 in 0.638s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:03 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "cinder-4663a82e-5d6d-4a55-9813-3c99b476b05c-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:03 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-4663a82e-5d6d-4a55-9813-3c99b476b05c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:03 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "cinder-quobyte-38bc83e8-1342-4844-be84-e86e83ea60b6" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:03 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac Nov 04 19:04:03 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-quobyte-38bc83e8-1342-4844-be84-e86e83ea60b6" acquired by "delete_snapshot" :: waited 0.075s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:03 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "cinder-quobyte-4663a82e-5d6d-4a55-9813-3c99b476b05c" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:03 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:03 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-quobyte-4663a82e-5d6d-4a55-9813-3c99b476b05c" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Deleting offline snapshot 4663a82e-5d6d-4a55-9813-3c99b476b05c of volume 38bc83e8-1342-4844-be84-e86e83ea60b6 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:04:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] snapshot_file for this snap is: volume-38bc83e8-1342-4844-be84-e86e83ea60b6.4663a82e-5d6d-4a55-9813-3c99b476b05c {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:04:03 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad66c3f-03b7-44bb-9342-ed78be3c65c3]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.4663a82e-5d6d-4a55-9813-3c99b476b05c {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:03 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac" returned: 0 in 0.349s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:04:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1495e4-e0e2-4e73-9120-a31ae873cb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a99845a-f96c-467a-9473-da87ca450eac', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f89fd95-3371-4e61-b1fd-dc5bbda00f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:03 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.4663a82e-5d6d-4a55-9813-3c99b476b05c Nov 04 19:04:03 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:03 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Volume volume-3a99845a-f96c-467a-9473-da87ca450eac (3a99845a-f96c-467a-9473-da87ca450eac): created successfully Nov 04 19:04:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f89fd95-3371-4e61-b1fd-dc5bbda00f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Flow 'volume_create_manager' (25a12bd2-0364-40f6-b544-bd27be460a19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:03 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-5b2ff8ae-d7bf-4698-8047-0094a2fc853f tempest-CinderUnicodeTest-444046007 None] Created volume successfully. Nov 04 19:04:03 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.4663a82e-5d6d-4a55-9813-3c99b476b05c" returned: 0 in 0.478s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38bc83e8-1342-4844-be84-e86e83ea60b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:04:03 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1807d50-9a88-4962-a9a8-79c86c25c3c5]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:03 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6 Nov 04 19:04:03 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-44dc12a2-895d-479f-9588-992a737c08a9 tempest-CinderUnicodeTest-444046007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-44dc12a2-895d-479f-9588-992a737c08a9 tempest-CinderUnicodeTest-444046007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:04 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-44dc12a2-895d-479f-9588-992a737c08a9 tempest-CinderUnicodeTest-444046007 None] Creating offline snapshot b8a4db77-d033-4168-a5a2-70851ef432be of volume 3a99845a-f96c-467a-9473-da87ca450eac {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:04:04 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5889b321-3f67-4c4d-b5c8-16f9578e0988]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-44dc12a2-895d-479f-9588-992a737c08a9 tempest-CinderUnicodeTest-444046007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:04 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-5d82eb96-c11f-49d8-a993-7c4b00463448 req-d2780483-15c8-4e17-be61-9d17e4b2783a tempest-TestShelveInstance-569206585 None] Terminate volume connection completed successfully. Nov 04 19:04:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [req-5d82eb96-c11f-49d8-a993-7c4b00463448 req-d2780483-15c8-4e17-be61-9d17e4b2783a tempest-TestShelveInstance-569206585 None] Deleting attachment 86db5a7e-b3fc-4de7-bb90-e5ba9b8e685a. {{(pid=87119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:04:04 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6" returned: 0 in 0.709s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.4663a82e-5d6d-4a55-9813-3c99b476b05c {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:04 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.4663a82e-5d6d-4a55-9813-3c99b476b05c Nov 04 19:04:04 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:04 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac Nov 04 19:04:04 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-5d82eb96-c11f-49d8-a993-7c4b00463448 req-c1ff05f8-061e-4879-b943-4bf31a80745e tempest-TestShelveInstance-569206585 None] Acquiring lock "cinder-5959aa91-350b-4071-a901-13098658a8df-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-5d82eb96-c11f-49d8-a993-7c4b00463448 req-c1ff05f8-061e-4879-b943-4bf31a80745e tempest-TestShelveInstance-569206585 None] Lock "cinder-5959aa91-350b-4071-a901-13098658a8df-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-5d82eb96-c11f-49d8-a993-7c4b00463448 req-c1ff05f8-061e-4879-b943-4bf31a80745e tempest-TestShelveInstance-569206585 None] Acquiring lock "cinder-quobyte-5959aa91-350b-4071-a901-13098658a8df" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-5d82eb96-c11f-49d8-a993-7c4b00463448 req-c1ff05f8-061e-4879-b943-4bf31a80745e tempest-TestShelveInstance-569206585 None] Lock "cinder-quobyte-5959aa91-350b-4071-a901-13098658a8df" acquired by "delete_volume" :: waited 0.020s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:04 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e40e69e-0770-4724-add1-622ef7bdd531]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-5d82eb96-c11f-49d8-a993-7c4b00463448 req-c1ff05f8-061e-4879-b943-4bf31a80745e tempest-TestShelveInstance-569206585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5959aa91-350b-4071-a901-13098658a8df {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:04 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-44dc12a2-895d-479f-9588-992a737c08a9 tempest-CinderUnicodeTest-444046007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac" returned: 0 in 0.416s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-44dc12a2-895d-479f-9588-992a737c08a9 tempest-CinderUnicodeTest-444046007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac.b8a4db77-d033-4168-a5a2-70851ef432be 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:04 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac.b8a4db77-d033-4168-a5a2-70851ef432be 1G Nov 04 19:04:04 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:04 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.4663a82e-5d6d-4a55-9813-3c99b476b05c" returned: 0 in 0.398s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.4663a82e-5d6d-4a55-9813-3c99b476b05c {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:04 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5959aa91-350b-4071-a901-13098658a8df Nov 04 19:04:04 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:04 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.4663a82e-5d6d-4a55-9813-3c99b476b05c Nov 04 19:04:04 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:05 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6.4663a82e-5d6d-4a55-9813-3c99b476b05c" returned: 0 in 0.302s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-quobyte-4663a82e-5d6d-4a55-9813-3c99b476b05c" released by "_delete_snapshot" :: held 2.051s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-quobyte-38bc83e8-1342-4844-be84-e86e83ea60b6" released by "delete_snapshot" :: held 2.108s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:05 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-5d82eb96-c11f-49d8-a993-7c4b00463448 req-c1ff05f8-061e-4879-b943-4bf31a80745e tempest-TestShelveInstance-569206585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5959aa91-350b-4071-a901-13098658a8df" returned: 0 in 0.484s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-5d82eb96-c11f-49d8-a993-7c4b00463448 req-c1ff05f8-061e-4879-b943-4bf31a80745e tempest-TestShelveInstance-569206585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5959aa91-350b-4071-a901-13098658a8df {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:05 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5959aa91-350b-4071-a901-13098658a8df Nov 04 19:04:05 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:05 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Created reservations ['a870a41c-4b1c-4684-9a38-016ac0b7d35e', '7185fa13-7eb3-482c-b900-194849996454', '53da8052-0be0-4039-b472-1f6b8415a0a5', '9c18eae8-2832-4b69-8617-7512915c740a'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:05 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:05 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Delete snapshot completed successfully. Nov 04 19:04:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-44dc12a2-895d-479f-9588-992a737c08a9 tempest-CinderUnicodeTest-444046007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac.b8a4db77-d033-4168-a5a2-70851ef432be 1G" returned: 0 in 0.551s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-44dc12a2-895d-479f-9588-992a737c08a9 tempest-CinderUnicodeTest-444046007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a99845a-f96c-467a-9473-da87ca450eac -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac.b8a4db77-d033-4168-a5a2-70851ef432be {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-4663a82e-5d6d-4a55-9813-3c99b476b05c-delete_snapshot" released by "delete_snapshot" :: held 2.395s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Snapshots deleted, issuing volume delete {{(pid=87119) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 04 19:04:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "cinder-quobyte-38bc83e8-1342-4844-be84-e86e83ea60b6" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:05 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a99845a-f96c-467a-9473-da87ca450eac -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac.b8a4db77-d033-4168-a5a2-70851ef432be Nov 04 19:04:05 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-quobyte-38bc83e8-1342-4844-be84-e86e83ea60b6" acquired by "delete_volume" :: waited 0.021s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:05 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd7c3dd-b6b0-47d7-9b9d-98a27a7a255f]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:05 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-5d82eb96-c11f-49d8-a993-7c4b00463448 req-c1ff05f8-061e-4879-b943-4bf31a80745e tempest-TestShelveInstance-569206585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5959aa91-350b-4071-a901-13098658a8df" returned: 0 in 0.303s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-5d82eb96-c11f-49d8-a993-7c4b00463448 req-c1ff05f8-061e-4879-b943-4bf31a80745e tempest-TestShelveInstance-569206585 None] Lock "cinder-quobyte-5959aa91-350b-4071-a901-13098658a8df" released by "delete_volume" :: held 0.842s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:05 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6 Nov 04 19:04:05 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:05 devstack cinder-volume[87119]: DEBUG cinder.quota [req-5d82eb96-c11f-49d8-a993-7c4b00463448 req-c1ff05f8-061e-4879-b943-4bf31a80745e tempest-TestShelveInstance-569206585 None] Created reservations ['154651bf-5f03-4c96-9237-9a22e9d55e81', '468c86a4-649d-4dad-a7e8-83a57fa2d79d', 'e2dabb1c-8ca1-468b-ac7d-e91992f08a3b', '5231c5c4-745f-4300-9b9b-69a910f89265'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-5d82eb96-c11f-49d8-a993-7c4b00463448 req-c1ff05f8-061e-4879-b943-4bf31a80745e tempest-TestShelveInstance-569206585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-5d82eb96-c11f-49d8-a993-7c4b00463448 req-c1ff05f8-061e-4879-b943-4bf31a80745e tempest-TestShelveInstance-569206585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [req-5d82eb96-c11f-49d8-a993-7c4b00463448 req-c1ff05f8-061e-4879-b943-4bf31a80745e tempest-TestShelveInstance-569206585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [req-5d82eb96-c11f-49d8-a993-7c4b00463448 req-c1ff05f8-061e-4879-b943-4bf31a80745e tempest-TestShelveInstance-569206585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [req-5d82eb96-c11f-49d8-a993-7c4b00463448 req-c1ff05f8-061e-4879-b943-4bf31a80745e tempest-TestShelveInstance-569206585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-5d82eb96-c11f-49d8-a993-7c4b00463448 req-c1ff05f8-061e-4879-b943-4bf31a80745e tempest-TestShelveInstance-569206585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:05 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:04:05 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:05 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-44dc12a2-895d-479f-9588-992a737c08a9 tempest-CinderUnicodeTest-444046007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a99845a-f96c-467a-9473-da87ca450eac -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac.b8a4db77-d033-4168-a5a2-70851ef432be" returned: 0 in 0.419s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:05 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-44dc12a2-895d-479f-9588-992a737c08a9 tempest-CinderUnicodeTest-444046007 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac.b8a4db77-d033-4168-a5a2-70851ef432be is being set with open permissions: ugo+rw Nov 04 19:04:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-44dc12a2-895d-479f-9588-992a737c08a9 tempest-CinderUnicodeTest-444046007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac.b8a4db77-d033-4168-a5a2-70851ef432be {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:05 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac.b8a4db77-d033-4168-a5a2-70851ef432be Nov 04 19:04:05 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:05 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6" returned: 0 in 0.447s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:05 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6 Nov 04 19:04:06 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:06 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [req-5d82eb96-c11f-49d8-a993-7c4b00463448 req-c1ff05f8-061e-4879-b943-4bf31a80745e tempest-TestShelveInstance-569206585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.324s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:06 devstack cinder-volume[87119]: DEBUG cinder.manager [req-5d82eb96-c11f-49d8-a993-7c4b00463448 req-c1ff05f8-061e-4879-b943-4bf31a80745e tempest-TestShelveInstance-569206585 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:06 devstack cinder-volume[87119]: INFO cinder.volume.manager [req-5d82eb96-c11f-49d8-a993-7c4b00463448 req-c1ff05f8-061e-4879-b943-4bf31a80745e tempest-TestShelveInstance-569206585 None] Deleted volume successfully. Nov 04 19:04:06 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-44dc12a2-895d-479f-9588-992a737c08a9 tempest-CinderUnicodeTest-444046007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac.b8a4db77-d033-4168-a5a2-70851ef432be" returned: 0 in 0.303s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [req-5d82eb96-c11f-49d8-a993-7c4b00463448 req-c1ff05f8-061e-4879-b943-4bf31a80745e tempest-TestShelveInstance-569206585 None] Lock "cinder-5959aa91-350b-4071-a901-13098658a8df-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-44dc12a2-895d-479f-9588-992a737c08a9 tempest-CinderUnicodeTest-444046007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:06 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac.info Nov 04 19:04:06 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:06 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38bc83e8-1342-4844-be84-e86e83ea60b6" returned: 0 in 0.332s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-quobyte-38bc83e8-1342-4844-be84-e86e83ea60b6" released by "delete_volume" :: held 0.864s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:06 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Created reservations ['898103c6-c0d1-482e-a681-fbf3abf26a55', 'dfc16d02-d856-467e-9a22-c102b3977d41', '052a2ed9-831e-4051-949b-ea6beb11c8fa', 'eb9d3627-b639-42f1-a566-a9a474b6f183'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:06 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:06 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:06 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-44dc12a2-895d-479f-9588-992a737c08a9 tempest-CinderUnicodeTest-444046007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac.info" returned: 0 in 0.304s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:06 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-44dc12a2-895d-479f-9588-992a737c08a9 tempest-CinderUnicodeTest-444046007 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac.info is being set with open permissions: ugo+rw Nov 04 19:04:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-44dc12a2-895d-479f-9588-992a737c08a9 tempest-CinderUnicodeTest-444046007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:06 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:04:06 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:06 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac.info Nov 04 19:04:06 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:06 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.235s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:06 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:06 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Deleted volume successfully. Nov 04 19:04:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-081e31d1-877d-47b1-8c77-44cd7b747320 tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-38bc83e8-1342-4844-be84-e86e83ea60b6-delete_volume" released by "delete_volume" :: held 3.844s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:06 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-44dc12a2-895d-479f-9588-992a737c08a9 tempest-CinderUnicodeTest-444046007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac.info" returned: 0 in 0.284s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-44dc12a2-895d-479f-9588-992a737c08a9 tempest-CinderUnicodeTest-444046007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.397s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:06 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-44dc12a2-895d-479f-9588-992a737c08a9 tempest-CinderUnicodeTest-444046007 None] Create snapshot completed successfully Nov 04 19:04:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a90a14d6-9065-422c-95cf-daea4ce7230b tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "cinder-7aaaa102-8071-4baf-bd8b-c7af2cda38c4-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a90a14d6-9065-422c-95cf-daea4ce7230b tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-7aaaa102-8071-4baf-bd8b-c7af2cda38c4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:07 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=180,cinder:UPDATE=215,cinder:DELETE=18,cinder:INSERT=59 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:04:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a90a14d6-9065-422c-95cf-daea4ce7230b tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "cinder-quobyte-7aaaa102-8071-4baf-bd8b-c7af2cda38c4" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a90a14d6-9065-422c-95cf-daea4ce7230b tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-quobyte-7aaaa102-8071-4baf-bd8b-c7af2cda38c4" acquired by "delete_volume" :: waited 0.016s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:07 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3ff841-30cd-4497-9a6d-a6ff0a179187]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a90a14d6-9065-422c-95cf-daea4ce7230b tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7aaaa102-8071-4baf-bd8b-c7af2cda38c4 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b6d4fe84-3335-4420-823d-58c967f23cf1 tempest-CinderUnicodeTest-444046007 None] Acquiring lock "cinder-b8a4db77-d033-4168-a5a2-70851ef432be-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b6d4fe84-3335-4420-823d-58c967f23cf1 tempest-CinderUnicodeTest-444046007 None] Lock "cinder-b8a4db77-d033-4168-a5a2-70851ef432be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b6d4fe84-3335-4420-823d-58c967f23cf1 tempest-CinderUnicodeTest-444046007 None] Acquiring lock "cinder-quobyte-3a99845a-f96c-467a-9473-da87ca450eac" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b6d4fe84-3335-4420-823d-58c967f23cf1 tempest-CinderUnicodeTest-444046007 None] Lock "cinder-quobyte-3a99845a-f96c-467a-9473-da87ca450eac" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b6d4fe84-3335-4420-823d-58c967f23cf1 tempest-CinderUnicodeTest-444046007 None] Acquiring lock "cinder-quobyte-b8a4db77-d033-4168-a5a2-70851ef432be" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b6d4fe84-3335-4420-823d-58c967f23cf1 tempest-CinderUnicodeTest-444046007 None] Lock "cinder-quobyte-b8a4db77-d033-4168-a5a2-70851ef432be" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-b6d4fe84-3335-4420-823d-58c967f23cf1 tempest-CinderUnicodeTest-444046007 None] Deleting offline snapshot b8a4db77-d033-4168-a5a2-70851ef432be of volume 3a99845a-f96c-467a-9473-da87ca450eac {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:04:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-b6d4fe84-3335-4420-823d-58c967f23cf1 tempest-CinderUnicodeTest-444046007 None] snapshot_file for this snap is: volume-3a99845a-f96c-467a-9473-da87ca450eac.b8a4db77-d033-4168-a5a2-70851ef432be {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:04:07 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7aaaa102-8071-4baf-bd8b-c7af2cda38c4 Nov 04 19:04:07 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:07 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf1d777-5dae-4eb5-ab28-21becdf3ba49]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b6d4fe84-3335-4420-823d-58c967f23cf1 tempest-CinderUnicodeTest-444046007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac.b8a4db77-d033-4168-a5a2-70851ef432be {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:07 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac.b8a4db77-d033-4168-a5a2-70851ef432be Nov 04 19:04:07 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:08 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a90a14d6-9065-422c-95cf-daea4ce7230b tempest-VolumesDeleteCascade-1472720059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7aaaa102-8071-4baf-bd8b-c7af2cda38c4" returned: 0 in 0.460s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a90a14d6-9065-422c-95cf-daea4ce7230b tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7aaaa102-8071-4baf-bd8b-c7af2cda38c4 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:08 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7aaaa102-8071-4baf-bd8b-c7af2cda38c4 Nov 04 19:04:08 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:08 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b6d4fe84-3335-4420-823d-58c967f23cf1 tempest-CinderUnicodeTest-444046007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac.b8a4db77-d033-4168-a5a2-70851ef432be" returned: 0 in 0.410s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-b6d4fe84-3335-4420-823d-58c967f23cf1 tempest-CinderUnicodeTest-444046007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a99845a-f96c-467a-9473-da87ca450eac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:04:08 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a87ca1-4dbc-49a0-b5e6-830fdce22c8f]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b6d4fe84-3335-4420-823d-58c967f23cf1 tempest-CinderUnicodeTest-444046007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:08 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a90a14d6-9065-422c-95cf-daea4ce7230b tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7aaaa102-8071-4baf-bd8b-c7af2cda38c4" returned: 0 in 0.281s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:08 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac Nov 04 19:04:08 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a90a14d6-9065-422c-95cf-daea4ce7230b tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-quobyte-7aaaa102-8071-4baf-bd8b-c7af2cda38c4" released by "delete_volume" :: held 0.799s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:08 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-a90a14d6-9065-422c-95cf-daea4ce7230b tempest-VolumesDeleteCascade-1472720059 None] Created reservations ['637bc941-3ee8-485c-860e-6e46b94c5a39', '18ce1979-f559-4e6c-b4dc-32ac7396afee', '9ae476db-3cee-4407-882e-44b1f4fbf3e1', '928ff557-02f6-4563-9be3-4971f7f6e9ee'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a90a14d6-9065-422c-95cf-daea4ce7230b tempest-VolumesDeleteCascade-1472720059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a90a14d6-9065-422c-95cf-daea4ce7230b tempest-VolumesDeleteCascade-1472720059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a90a14d6-9065-422c-95cf-daea4ce7230b tempest-VolumesDeleteCascade-1472720059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a90a14d6-9065-422c-95cf-daea4ce7230b tempest-VolumesDeleteCascade-1472720059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a90a14d6-9065-422c-95cf-daea4ce7230b tempest-VolumesDeleteCascade-1472720059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a90a14d6-9065-422c-95cf-daea4ce7230b tempest-VolumesDeleteCascade-1472720059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:08 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:04:08 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:08 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b6d4fe84-3335-4420-823d-58c967f23cf1 tempest-CinderUnicodeTest-444046007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac" returned: 0 in 0.439s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b6d4fe84-3335-4420-823d-58c967f23cf1 tempest-CinderUnicodeTest-444046007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac.b8a4db77-d033-4168-a5a2-70851ef432be {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:08 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac.b8a4db77-d033-4168-a5a2-70851ef432be Nov 04 19:04:08 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:08 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a90a14d6-9065-422c-95cf-daea4ce7230b tempest-VolumesDeleteCascade-1472720059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.339s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:08 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-a90a14d6-9065-422c-95cf-daea4ce7230b tempest-VolumesDeleteCascade-1472720059 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:08 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-a90a14d6-9065-422c-95cf-daea4ce7230b tempest-VolumesDeleteCascade-1472720059 None] Deleted volume successfully. Nov 04 19:04:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a90a14d6-9065-422c-95cf-daea4ce7230b tempest-VolumesDeleteCascade-1472720059 None] Lock "cinder-7aaaa102-8071-4baf-bd8b-c7af2cda38c4-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:09 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b6d4fe84-3335-4420-823d-58c967f23cf1 tempest-CinderUnicodeTest-444046007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac.b8a4db77-d033-4168-a5a2-70851ef432be" returned: 0 in 0.427s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b6d4fe84-3335-4420-823d-58c967f23cf1 tempest-CinderUnicodeTest-444046007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac.b8a4db77-d033-4168-a5a2-70851ef432be {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:09 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac.b8a4db77-d033-4168-a5a2-70851ef432be Nov 04 19:04:09 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:09 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b6d4fe84-3335-4420-823d-58c967f23cf1 tempest-CinderUnicodeTest-444046007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac.b8a4db77-d033-4168-a5a2-70851ef432be" returned: 0 in 0.255s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b6d4fe84-3335-4420-823d-58c967f23cf1 tempest-CinderUnicodeTest-444046007 None] Lock "cinder-quobyte-b8a4db77-d033-4168-a5a2-70851ef432be" released by "_delete_snapshot" :: held 1.679s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b6d4fe84-3335-4420-823d-58c967f23cf1 tempest-CinderUnicodeTest-444046007 None] Lock "cinder-quobyte-3a99845a-f96c-467a-9473-da87ca450eac" released by "delete_snapshot" :: held 1.705s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:09 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-b6d4fe84-3335-4420-823d-58c967f23cf1 tempest-CinderUnicodeTest-444046007 None] Created reservations ['1e563c72-c04e-4d00-b8e5-ea717e7055e4', 'ed357057-586f-4140-a7ca-0929fb2cc6df', 'cddf49d3-11f9-47ff-81fd-6011ce751a2e', 'ebc7ffaa-d1c8-4861-8bbe-b80800395f6c'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:09 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-b6d4fe84-3335-4420-823d-58c967f23cf1 tempest-CinderUnicodeTest-444046007 None] Delete snapshot completed successfully. Nov 04 19:04:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b6d4fe84-3335-4420-823d-58c967f23cf1 tempest-CinderUnicodeTest-444046007 None] Lock "cinder-b8a4db77-d033-4168-a5a2-70851ef432be-delete_snapshot" released by "delete_snapshot" :: held 1.887s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-90343f85-cc7a-4b63-b5b8-90a27468dc4e tempest-CinderUnicodeTest-444046007 None] Acquiring lock "cinder-3a99845a-f96c-467a-9473-da87ca450eac-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-90343f85-cc7a-4b63-b5b8-90a27468dc4e tempest-CinderUnicodeTest-444046007 None] Lock "cinder-3a99845a-f96c-467a-9473-da87ca450eac-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-90343f85-cc7a-4b63-b5b8-90a27468dc4e tempest-CinderUnicodeTest-444046007 None] Acquiring lock "cinder-quobyte-3a99845a-f96c-467a-9473-da87ca450eac" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-90343f85-cc7a-4b63-b5b8-90a27468dc4e tempest-CinderUnicodeTest-444046007 None] Lock "cinder-quobyte-3a99845a-f96c-467a-9473-da87ca450eac" acquired by "delete_volume" :: waited 0.027s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:10 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6f4a01-de00-4f99-9f8e-cf556a568a5e]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-90343f85-cc7a-4b63-b5b8-90a27468dc4e tempest-CinderUnicodeTest-444046007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:10 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac Nov 04 19:04:10 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:10 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-90343f85-cc7a-4b63-b5b8-90a27468dc4e tempest-CinderUnicodeTest-444046007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac" returned: 0 in 0.457s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-90343f85-cc7a-4b63-b5b8-90a27468dc4e tempest-CinderUnicodeTest-444046007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:10 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac Nov 04 19:04:10 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:10 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-90343f85-cc7a-4b63-b5b8-90a27468dc4e tempest-CinderUnicodeTest-444046007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a99845a-f96c-467a-9473-da87ca450eac" returned: 0 in 0.292s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-90343f85-cc7a-4b63-b5b8-90a27468dc4e tempest-CinderUnicodeTest-444046007 None] Lock "cinder-quobyte-3a99845a-f96c-467a-9473-da87ca450eac" released by "delete_volume" :: held 0.843s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:10 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:UPDATE=245,cinder:SELECT=179,cinder:INSERT=54,cinder:DELETE=22 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:04:10 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-90343f85-cc7a-4b63-b5b8-90a27468dc4e tempest-CinderUnicodeTest-444046007 None] Created reservations ['c3a21a46-fd2a-4dc4-8998-50b7eca2ab9c', '9d4851c2-f435-4763-bcd8-8ad0aa9a7af0', '096f724a-0858-4016-96a3-7d95390d15b4', 'c03559ac-34a3-4abe-bd3e-14d26f516b5d'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-90343f85-cc7a-4b63-b5b8-90a27468dc4e tempest-CinderUnicodeTest-444046007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-90343f85-cc7a-4b63-b5b8-90a27468dc4e tempest-CinderUnicodeTest-444046007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:11 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-90343f85-cc7a-4b63-b5b8-90a27468dc4e tempest-CinderUnicodeTest-444046007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:11 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-90343f85-cc7a-4b63-b5b8-90a27468dc4e tempest-CinderUnicodeTest-444046007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-90343f85-cc7a-4b63-b5b8-90a27468dc4e tempest-CinderUnicodeTest-444046007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-90343f85-cc7a-4b63-b5b8-90a27468dc4e tempest-CinderUnicodeTest-444046007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:11 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:04:11 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:11 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5ce73400-65b9-4292-8e30-48fe80454130 tempest-CinderUnicodeTest-444046007 None] Acquiring lock "cinder-449c5323-91b8-44b3-9f07-7f090a9a8497-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:11 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5ce73400-65b9-4292-8e30-48fe80454130 tempest-CinderUnicodeTest-444046007 None] Lock "cinder-449c5323-91b8-44b3-9f07-7f090a9a8497-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:11 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5ce73400-65b9-4292-8e30-48fe80454130 tempest-CinderUnicodeTest-444046007 None] Acquiring lock "cinder-quobyte-449c5323-91b8-44b3-9f07-7f090a9a8497" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:11 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5ce73400-65b9-4292-8e30-48fe80454130 tempest-CinderUnicodeTest-444046007 None] Lock "cinder-quobyte-449c5323-91b8-44b3-9f07-7f090a9a8497" acquired by "delete_volume" :: waited 0.024s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:11 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0f33c1-0e83-461c-a3ff-7c5d00cdd8a7]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5ce73400-65b9-4292-8e30-48fe80454130 tempest-CinderUnicodeTest-444046007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-449c5323-91b8-44b3-9f07-7f090a9a8497 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:11 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-90343f85-cc7a-4b63-b5b8-90a27468dc4e tempest-CinderUnicodeTest-444046007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.328s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:11 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-90343f85-cc7a-4b63-b5b8-90a27468dc4e tempest-CinderUnicodeTest-444046007 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:11 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-90343f85-cc7a-4b63-b5b8-90a27468dc4e tempest-CinderUnicodeTest-444046007 None] Deleted volume successfully. Nov 04 19:04:11 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-449c5323-91b8-44b3-9f07-7f090a9a8497 Nov 04 19:04:11 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:11 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-90343f85-cc7a-4b63-b5b8-90a27468dc4e tempest-CinderUnicodeTest-444046007 None] Lock "cinder-3a99845a-f96c-467a-9473-da87ca450eac-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:11 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5ce73400-65b9-4292-8e30-48fe80454130 tempest-CinderUnicodeTest-444046007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-449c5323-91b8-44b3-9f07-7f090a9a8497" returned: 0 in 0.424s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5ce73400-65b9-4292-8e30-48fe80454130 tempest-CinderUnicodeTest-444046007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-449c5323-91b8-44b3-9f07-7f090a9a8497 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:11 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-449c5323-91b8-44b3-9f07-7f090a9a8497 Nov 04 19:04:11 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:12 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5ce73400-65b9-4292-8e30-48fe80454130 tempest-CinderUnicodeTest-444046007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-449c5323-91b8-44b3-9f07-7f090a9a8497" returned: 0 in 0.314s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5ce73400-65b9-4292-8e30-48fe80454130 tempest-CinderUnicodeTest-444046007 None] Lock "cinder-quobyte-449c5323-91b8-44b3-9f07-7f090a9a8497" released by "delete_volume" :: held 0.812s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:12 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-5ce73400-65b9-4292-8e30-48fe80454130 tempest-CinderUnicodeTest-444046007 None] Created reservations ['aebf8fac-3dd2-4b2f-8809-b5033a0388ae', '328c5326-800c-49da-a695-db449dcc56e0', 'fd7dc90d-f5ad-4b10-84d0-042e34f6e0ce', '7f436ae4-457a-40a6-b9a9-c493c88d9690'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5ce73400-65b9-4292-8e30-48fe80454130 tempest-CinderUnicodeTest-444046007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5ce73400-65b9-4292-8e30-48fe80454130 tempest-CinderUnicodeTest-444046007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:12 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5ce73400-65b9-4292-8e30-48fe80454130 tempest-CinderUnicodeTest-444046007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:12 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5ce73400-65b9-4292-8e30-48fe80454130 tempest-CinderUnicodeTest-444046007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5ce73400-65b9-4292-8e30-48fe80454130 tempest-CinderUnicodeTest-444046007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5ce73400-65b9-4292-8e30-48fe80454130 tempest-CinderUnicodeTest-444046007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:12 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:04:12 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:12 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5ce73400-65b9-4292-8e30-48fe80454130 tempest-CinderUnicodeTest-444046007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.281s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:12 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-5ce73400-65b9-4292-8e30-48fe80454130 tempest-CinderUnicodeTest-444046007 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:12 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-5ce73400-65b9-4292-8e30-48fe80454130 tempest-CinderUnicodeTest-444046007 None] Deleted volume successfully. Nov 04 19:04:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5ce73400-65b9-4292-8e30-48fe80454130 tempest-CinderUnicodeTest-444046007 None] Lock "cinder-449c5323-91b8-44b3-9f07-7f090a9a8497-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:15 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:15 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Flow 'volume_create_manager' (24e0a9fe-df19-459b-a57f-8c799ed46b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:15 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e5c355-e2fc-42ae-b7f9-03e73759432b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:15 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e5c355-e2fc-42ae-b7f9-03e73759432b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-233457671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa65088-3ac8-4306-bb7d-f1891113cc6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94235bd06a8b4b9f895aad43ed81bdb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:15Z,use_quota=True,user_id='9a93f2583a5c463d9298f6355489eb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:15 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (958a1876-bf70-46eb-92bc-a9eae0c61c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:15 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (958a1876-bf70-46eb-92bc-a9eae0c61c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:15 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec026da-913d-437b-93ee-68abda46fa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:15 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec026da-913d-437b-93ee-68abda46fa28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aa65088-3ac8-4306-bb7d-f1891113cc6b', 'volume_name': 'volume-3aa65088-3ac8-4306-bb7d-f1891113cc6b', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:15 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b69c02-8cf8-4768-ad30-ce307ba0cf26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:15 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b69c02-8cf8-4768-ad30-ce307ba0cf26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:15 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7367814-8923-49df-a773-65e56de8d37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:15 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Volume 3aa65088-3ac8-4306-bb7d-f1891113cc6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aa65088-3ac8-4306-bb7d-f1891113cc6b', 'volume_size': 1} Nov 04 19:04:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:15 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-233457671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa65088-3ac8-4306-bb7d-f1891113cc6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94235bd06a8b4b9f895aad43ed81bdb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:15Z,use_quota=True,user_id='9a93f2583a5c463d9298f6355489eb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:04:15 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Creating volume 3aa65088-3ac8-4306-bb7d-f1891113cc6b {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:04:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:15 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:15 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:15 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:04:15 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:04:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3aa65088-3ac8-4306-bb7d-f1891113cc6b 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:15 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3aa65088-3ac8-4306-bb7d-f1891113cc6b 1073741824 Nov 04 19:04:15 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:15 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3aa65088-3ac8-4306-bb7d-f1891113cc6b 1073741824" returned: 0 in 0.647s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3aa65088-3ac8-4306-bb7d-f1891113cc6b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:15 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3aa65088-3ac8-4306-bb7d-f1891113cc6b Nov 04 19:04:15 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:16 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3aa65088-3ac8-4306-bb7d-f1891113cc6b" returned: 0 in 0.356s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:16 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:04:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:16 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7367814-8923-49df-a773-65e56de8d37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aa65088-3ac8-4306-bb7d-f1891113cc6b', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:16 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b4c5f9-54fa-4ed5-84c5-b4b851631061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:16 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Volume volume-3aa65088-3ac8-4306-bb7d-f1891113cc6b (3aa65088-3ac8-4306-bb7d-f1891113cc6b): created successfully Nov 04 19:04:16 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b4c5f9-54fa-4ed5-84c5-b4b851631061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:16 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Flow 'volume_create_manager' (24e0a9fe-df19-459b-a57f-8c799ed46b58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:16 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-1d0f9200-0782-49dd-a82b-d33b13269a6f tempest-VolumesTransfersTest-2026190233 None] Created volume successfully. Nov 04 19:04:18 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-edbcd1c7-6009-4ec3-a364-b6f106fa40d3 tempest-VolumesTransfersTest-1362482938 None] Transfer volume completed successfully. Nov 04 19:04:19 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-27762d0d-288d-44f7-ae67-0c85c50dc932 tempest-VolumesTransfersTest-670376260 None] Acquiring lock "cinder-3aa65088-3ac8-4306-bb7d-f1891113cc6b-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:19 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-27762d0d-288d-44f7-ae67-0c85c50dc932 tempest-VolumesTransfersTest-670376260 None] Lock "cinder-3aa65088-3ac8-4306-bb7d-f1891113cc6b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:19 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-27762d0d-288d-44f7-ae67-0c85c50dc932 tempest-VolumesTransfersTest-670376260 None] Acquiring lock "cinder-quobyte-3aa65088-3ac8-4306-bb7d-f1891113cc6b" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:19 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-27762d0d-288d-44f7-ae67-0c85c50dc932 tempest-VolumesTransfersTest-670376260 None] Lock "cinder-quobyte-3aa65088-3ac8-4306-bb7d-f1891113cc6b" acquired by "delete_volume" :: waited 0.018s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:19 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1219283-4e59-4dd0-8fce-d9e6e5afc025]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-27762d0d-288d-44f7-ae67-0c85c50dc932 tempest-VolumesTransfersTest-670376260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3aa65088-3ac8-4306-bb7d-f1891113cc6b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:19 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3aa65088-3ac8-4306-bb7d-f1891113cc6b Nov 04 19:04:19 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:19 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-27762d0d-288d-44f7-ae67-0c85c50dc932 tempest-VolumesTransfersTest-670376260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3aa65088-3ac8-4306-bb7d-f1891113cc6b" returned: 0 in 0.396s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-27762d0d-288d-44f7-ae67-0c85c50dc932 tempest-VolumesTransfersTest-670376260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3aa65088-3ac8-4306-bb7d-f1891113cc6b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:19 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3aa65088-3ac8-4306-bb7d-f1891113cc6b Nov 04 19:04:19 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:19 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-27762d0d-288d-44f7-ae67-0c85c50dc932 tempest-VolumesTransfersTest-670376260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3aa65088-3ac8-4306-bb7d-f1891113cc6b" returned: 0 in 0.260s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:19 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-27762d0d-288d-44f7-ae67-0c85c50dc932 tempest-VolumesTransfersTest-670376260 None] Lock "cinder-quobyte-3aa65088-3ac8-4306-bb7d-f1891113cc6b" released by "delete_volume" :: held 0.716s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:19 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-27762d0d-288d-44f7-ae67-0c85c50dc932 tempest-VolumesTransfersTest-670376260 None] Created reservations ['0fd41026-caad-4b51-ba80-0849ba74455f', '0e095817-d738-4edf-9251-cb7b5c2c73c3', '06d43987-8827-4b48-8804-a17c217a8bd0', '01590905-36a0-4ee4-9cce-99b911529a96'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-27762d0d-288d-44f7-ae67-0c85c50dc932 tempest-VolumesTransfersTest-670376260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-27762d0d-288d-44f7-ae67-0c85c50dc932 tempest-VolumesTransfersTest-670376260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-27762d0d-288d-44f7-ae67-0c85c50dc932 tempest-VolumesTransfersTest-670376260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-27762d0d-288d-44f7-ae67-0c85c50dc932 tempest-VolumesTransfersTest-670376260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-27762d0d-288d-44f7-ae67-0c85c50dc932 tempest-VolumesTransfersTest-670376260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-27762d0d-288d-44f7-ae67-0c85c50dc932 tempest-VolumesTransfersTest-670376260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:20 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:04:20 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:20 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-27762d0d-288d-44f7-ae67-0c85c50dc932 tempest-VolumesTransfersTest-670376260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.346s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-27762d0d-288d-44f7-ae67-0c85c50dc932 tempest-VolumesTransfersTest-670376260 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:20 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-27762d0d-288d-44f7-ae67-0c85c50dc932 tempest-VolumesTransfersTest-670376260 None] Deleted volume successfully. Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-27762d0d-288d-44f7-ae67-0c85c50dc932 tempest-VolumesTransfersTest-670376260 None] Lock "cinder-3aa65088-3ac8-4306-bb7d-f1891113cc6b-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Flow 'volume_create_manager' (0f70ec33-7192-45a9-a76c-a1d5c0ed4940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740a22d9-23b1-4895-941b-20f6e459761f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740a22d9-23b1-4895-941b-20f6e459761f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-64756775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a4954e-1488-4761-b14d-7abc07fcb490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac17a81886242feaf82e1a61c77dbb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:20Z,use_quota=True,user_id='0b225ee4e0fd4028a4b8b0e8bef30d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8284c17e-2ca6-4a2b-8c6d-2889c4037621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8284c17e-2ca6-4a2b-8c6d-2889c4037621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3766482-28a5-4d53-beca-975fb0d94d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3766482-28a5-4d53-beca-975fb0d94d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34a4954e-1488-4761-b14d-7abc07fcb490', 'volume_name': 'volume-34a4954e-1488-4761-b14d-7abc07fcb490', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d30fa79-1265-43a0-9ba4-1a50f5f1f208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d30fa79-1265-43a0-9ba4-1a50f5f1f208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f75f39-8c09-4cdd-b454-6e19a2b7d09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:20 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Volume 34a4954e-1488-4761-b14d-7abc07fcb490: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34a4954e-1488-4761-b14d-7abc07fcb490', 'volume_size': 1} Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-64756775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a4954e-1488-4761-b14d-7abc07fcb490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac17a81886242feaf82e1a61c77dbb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:20Z,use_quota=True,user_id='0b225ee4e0fd4028a4b8b0e8bef30d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Creating volume 34a4954e-1488-4761-b14d-7abc07fcb490 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:04:20 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:04:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-34a4954e-1488-4761-b14d-7abc07fcb490 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:20 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-34a4954e-1488-4761-b14d-7abc07fcb490 1073741824 Nov 04 19:04:20 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Flow 'volume_create_manager' (a2b3a62e-d7c7-4907-8d1c-002b9ee3bddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e63ba807-cc48-49f6-a056-9e7a6d3a5821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e63ba807-cc48-49f6-a056-9e7a6d3a5821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-536561558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=781a81b5-9bac-4cf7-a64e-020fcb4ca629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94235bd06a8b4b9f895aad43ed81bdb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:21Z,use_quota=True,user_id='9a93f2583a5c463d9298f6355489eb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c184c4ad-dc79-4c54-a0f4-28e9c7e86020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c184c4ad-dc79-4c54-a0f4-28e9c7e86020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98ec66d9-8c26-4012-8995-3b12b1f11a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98ec66d9-8c26-4012-8995-3b12b1f11a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '781a81b5-9bac-4cf7-a64e-020fcb4ca629', 'volume_name': 'volume-781a81b5-9bac-4cf7-a64e-020fcb4ca629', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f985d4f8-ac68-4faf-803b-ef70b8d01c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f985d4f8-ac68-4faf-803b-ef70b8d01c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a52fd0a2-5a11-4ba4-bd77-d6d4efa598c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:21 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Volume 781a81b5-9bac-4cf7-a64e-020fcb4ca629: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-781a81b5-9bac-4cf7-a64e-020fcb4ca629', 'volume_size': 1} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:21 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-34a4954e-1488-4761-b14d-7abc07fcb490 1073741824" returned: 0 in 0.589s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-34a4954e-1488-4761-b14d-7abc07fcb490 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:21 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-34a4954e-1488-4761-b14d-7abc07fcb490 Nov 04 19:04:21 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Flow 'volume_create_manager' (d54266d5-f7e7-4278-907d-ed0c3efb9ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82cf3568-a474-4abe-9c20-b61e1e7347ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82cf3568-a474-4abe-9c20-b61e1e7347ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-612378569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=609e20bf-451f-4a18-88ba-e715d2dccdca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac17a81886242feaf82e1a61c77dbb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:22Z,use_quota=True,user_id='0b225ee4e0fd4028a4b8b0e8bef30d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e2238fa-241e-407b-a5ce-02b03567fbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e2238fa-241e-407b-a5ce-02b03567fbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d9ecb1d-64da-4bad-a2ee-8c43b87af2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d9ecb1d-64da-4bad-a2ee-8c43b87af2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '609e20bf-451f-4a18-88ba-e715d2dccdca', 'volume_name': 'volume-609e20bf-451f-4a18-88ba-e715d2dccdca', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abda42ab-0b09-46f4-9cb5-0c50056a64e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abda42ab-0b09-46f4-9cb5-0c50056a64e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d8111b-653a-4bea-ac38-9df570fd1d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:21 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Volume 609e20bf-451f-4a18-88ba-e715d2dccdca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-609e20bf-451f-4a18-88ba-e715d2dccdca', 'volume_size': 1} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Flow 'volume_create_manager' (d67164c4-d169-4410-8fc4-96176dcbd477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2fea664-3c23-4d0d-98f3-20edc7725882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2fea664-3c23-4d0d-98f3-20edc7725882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1176611724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19067018-6560-4329-9339-a6880b28ce5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac17a81886242feaf82e1a61c77dbb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:22Z,use_quota=True,user_id='0b225ee4e0fd4028a4b8b0e8bef30d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2b8228-b59d-49c0-a28d-57ca962265f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2b8228-b59d-49c0-a28d-57ca962265f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ce6609-8afb-48b0-ae0b-c79419711067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ce6609-8afb-48b0-ae0b-c79419711067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19067018-6560-4329-9339-a6880b28ce5d', 'volume_name': 'volume-19067018-6560-4329-9339-a6880b28ce5d', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:21 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0922f493-dbf3-4510-8c72-7cdac8781482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0922f493-dbf3-4510-8c72-7cdac8781482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb7be3b-433c-4321-90ae-7973554e4c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:21 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Volume 19067018-6560-4329-9339-a6880b28ce5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19067018-6560-4329-9339-a6880b28ce5d', 'volume_size': 1} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-34a4954e-1488-4761-b14d-7abc07fcb490" returned: 0 in 0.426s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.580s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-536561558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=781a81b5-9bac-4cf7-a64e-020fcb4ca629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94235bd06a8b4b9f895aad43ed81bdb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:21Z,use_quota=True,user_id='9a93f2583a5c463d9298f6355489eb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Creating volume 781a81b5-9bac-4cf7-a64e-020fcb4ca629 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:04:21 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-781a81b5-9bac-4cf7-a64e-020fcb4ca629 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f75f39-8c09-4cdd-b454-6e19a2b7d09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34a4954e-1488-4761-b14d-7abc07fcb490', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:21 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-781a81b5-9bac-4cf7-a64e-020fcb4ca629 1073741824 Nov 04 19:04:21 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5fadff-6d21-46c0-aad7-a75917231b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Flow 'volume_create_manager' (bdb7ea71-d031-4dcc-bc5c-a9f490b07dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97eb033b-39c3-43b7-a136-406b8b2afff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:22 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Volume volume-34a4954e-1488-4761-b14d-7abc07fcb490 (34a4954e-1488-4761-b14d-7abc07fcb490): created successfully Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5fadff-6d21-46c0-aad7-a75917231b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Flow 'volume_create_manager' (0f70ec33-7192-45a9-a76c-a1d5c0ed4940) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97eb033b-39c3-43b7-a136-406b8b2afff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-913243065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ae10753-2166-44fc-beae-b9ea526a0eee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac17a81886242feaf82e1a61c77dbb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:22Z,use_quota=True,user_id='0b225ee4e0fd4028a4b8b0e8bef30d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (254d2590-37f6-4720-8a54-e94071343a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (254d2590-37f6-4720-8a54-e94071343a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7da5f0-c008-4a13-92a2-e2db7480ead1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7da5f0-c008-4a13-92a2-e2db7480ead1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ae10753-2166-44fc-beae-b9ea526a0eee', 'volume_name': 'volume-8ae10753-2166-44fc-beae-b9ea526a0eee', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b95c9b47-a6a5-4668-b5c5-663817ce76fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b95c9b47-a6a5-4668-b5c5-663817ce76fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c93d079-fccd-4001-ae6a-a799b5afcafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:22 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Volume 8ae10753-2166-44fc-beae-b9ea526a0eee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ae10753-2166-44fc-beae-b9ea526a0eee', 'volume_size': 1} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:22 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-69ef2335-f845-41f5-8bc3-4e646a775542 tempest-CreateVolumesFromImageTest-1823262119 None] Created volume successfully. Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:22 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Flow 'volume_create_manager' (6d9dbc0e-a01d-4a7d-b3bc-a71fa5e15163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c3e5ed-8c02-4b45-9be9-2086a0a9a320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-781a81b5-9bac-4cf7-a64e-020fcb4ca629 1073741824" returned: 0 in 0.610s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c3e5ed-8c02-4b45-9be9-2086a0a9a320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-817447742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a3f28a-ad9f-4baa-bc22-9d7ea07e933e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac17a81886242feaf82e1a61c77dbb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:22Z,use_quota=True,user_id='0b225ee4e0fd4028a4b8b0e8bef30d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (171d0367-0662-4617-8176-8ff3fe92b3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (171d0367-0662-4617-8176-8ff3fe92b3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (328b539e-282f-4baa-aed3-21d46f635ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (328b539e-282f-4baa-aed3-21d46f635ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4a3f28a-ad9f-4baa-bc22-9d7ea07e933e', 'volume_name': 'volume-a4a3f28a-ad9f-4baa-bc22-9d7ea07e933e', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e6ebf4-bb58-43ca-8568-ec1b15a869b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e6ebf4-bb58-43ca-8568-ec1b15a869b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b54e5eff-c647-47dd-ab2d-03a6f9a59b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:22 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Volume a4a3f28a-ad9f-4baa-bc22-9d7ea07e933e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4a3f28a-ad9f-4baa-bc22-9d7ea07e933e', 'volume_size': 1} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-781a81b5-9bac-4cf7-a64e-020fcb4ca629 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:22 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-781a81b5-9bac-4cf7-a64e-020fcb4ca629 Nov 04 19:04:22 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:22 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-781a81b5-9bac-4cf7-a64e-020fcb4ca629" returned: 0 in 0.286s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.151s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-612378569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=609e20bf-451f-4a18-88ba-e715d2dccdca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac17a81886242feaf82e1a61c77dbb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:22Z,use_quota=True,user_id='0b225ee4e0fd4028a4b8b0e8bef30d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Creating volume 609e20bf-451f-4a18-88ba-e715d2dccdca {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:04:22 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-609e20bf-451f-4a18-88ba-e715d2dccdca 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a52fd0a2-5a11-4ba4-bd77-d6d4efa598c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-781a81b5-9bac-4cf7-a64e-020fcb4ca629', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643a8266-8415-43c1-b830-2f04869ac03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:22 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-609e20bf-451f-4a18-88ba-e715d2dccdca 1073741824 Nov 04 19:04:22 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:22 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Volume volume-781a81b5-9bac-4cf7-a64e-020fcb4ca629 (781a81b5-9bac-4cf7-a64e-020fcb4ca629): created successfully Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643a8266-8415-43c1-b830-2f04869ac03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Flow 'volume_create_manager' (a2b3a62e-d7c7-4907-8d1c-002b9ee3bddc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:22 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-683c7feb-8a4b-4592-b5c6-e91c47aece1c tempest-VolumesTransfersTest-2026190233 None] Created volume successfully. Nov 04 19:04:23 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:23 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0a55bba5-6d50-4d4e-9e22-b284fd3d8c04 tempest-VolumesTransfersTest-670376260 None] Acquiring lock "cinder-781a81b5-9bac-4cf7-a64e-020fcb4ca629-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-609e20bf-451f-4a18-88ba-e715d2dccdca 1073741824" returned: 0 in 0.691s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:23 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0a55bba5-6d50-4d4e-9e22-b284fd3d8c04 tempest-VolumesTransfersTest-670376260 None] Lock "cinder-781a81b5-9bac-4cf7-a64e-020fcb4ca629-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:23 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0a55bba5-6d50-4d4e-9e22-b284fd3d8c04 tempest-VolumesTransfersTest-670376260 None] Acquiring lock "cinder-quobyte-781a81b5-9bac-4cf7-a64e-020fcb4ca629" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-609e20bf-451f-4a18-88ba-e715d2dccdca {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:23 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0a55bba5-6d50-4d4e-9e22-b284fd3d8c04 tempest-VolumesTransfersTest-670376260 None] Lock "cinder-quobyte-781a81b5-9bac-4cf7-a64e-020fcb4ca629" acquired by "delete_volume" :: waited 0.046s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:23 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-609e20bf-451f-4a18-88ba-e715d2dccdca Nov 04 19:04:23 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:23 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb9a1cd-b487-404f-a388-5acd17172ad8]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0a55bba5-6d50-4d4e-9e22-b284fd3d8c04 tempest-VolumesTransfersTest-670376260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-781a81b5-9bac-4cf7-a64e-020fcb4ca629 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:23 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-781a81b5-9bac-4cf7-a64e-020fcb4ca629 Nov 04 19:04:23 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:23 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-609e20bf-451f-4a18-88ba-e715d2dccdca" returned: 0 in 0.316s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:23 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:04:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.113s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:23 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1176611724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19067018-6560-4329-9339-a6880b28ce5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac17a81886242feaf82e1a61c77dbb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:22Z,use_quota=True,user_id='0b225ee4e0fd4028a4b8b0e8bef30d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:04:23 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Creating volume 19067018-6560-4329-9339-a6880b28ce5d {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:04:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:23 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:23 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:23 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:04:23 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:04:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-19067018-6560-4329-9339-a6880b28ce5d 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d8111b-653a-4bea-ac38-9df570fd1d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-609e20bf-451f-4a18-88ba-e715d2dccdca', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3aa63f9-9eae-49be-948b-43bcabbd2bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:24 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-19067018-6560-4329-9339-a6880b28ce5d 1073741824 Nov 04 19:04:24 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:24 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Volume volume-609e20bf-451f-4a18-88ba-e715d2dccdca (609e20bf-451f-4a18-88ba-e715d2dccdca): created successfully Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3aa63f9-9eae-49be-948b-43bcabbd2bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Flow 'volume_create_manager' (d54266d5-f7e7-4278-907d-ed0c3efb9ce0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:24 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-bdb6d288-9d37-45ba-89cf-e1368636a1b4 tempest-CreateVolumesFromImageTest-1823262119 None] Created volume successfully. Nov 04 19:04:24 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0a55bba5-6d50-4d4e-9e22-b284fd3d8c04 tempest-VolumesTransfersTest-670376260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-781a81b5-9bac-4cf7-a64e-020fcb4ca629" returned: 0 in 0.482s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0a55bba5-6d50-4d4e-9e22-b284fd3d8c04 tempest-VolumesTransfersTest-670376260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-781a81b5-9bac-4cf7-a64e-020fcb4ca629 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:24 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-781a81b5-9bac-4cf7-a64e-020fcb4ca629 Nov 04 19:04:24 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:24 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0a55bba5-6d50-4d4e-9e22-b284fd3d8c04 tempest-VolumesTransfersTest-670376260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-781a81b5-9bac-4cf7-a64e-020fcb4ca629" returned: 0 in 0.321s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:24 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0a55bba5-6d50-4d4e-9e22-b284fd3d8c04 tempest-VolumesTransfersTest-670376260 None] Lock "cinder-quobyte-781a81b5-9bac-4cf7-a64e-020fcb4ca629" released by "delete_volume" :: held 0.864s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-19067018-6560-4329-9339-a6880b28ce5d 1073741824" returned: 0 in 0.574s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-19067018-6560-4329-9339-a6880b28ce5d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:24 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-19067018-6560-4329-9339-a6880b28ce5d Nov 04 19:04:24 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-0a55bba5-6d50-4d4e-9e22-b284fd3d8c04 tempest-VolumesTransfersTest-670376260 None] Created reservations ['28461314-0481-4be4-b771-35d36d600830', 'd81c8021-1ee3-48fe-9365-c05abddeb1c5', 'd7796b64-1bf6-4d66-991e-f5a615eb0f20', 'f226d4a2-d319-4e06-a7d6-bd598f9d8396'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0a55bba5-6d50-4d4e-9e22-b284fd3d8c04 tempest-VolumesTransfersTest-670376260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0a55bba5-6d50-4d4e-9e22-b284fd3d8c04 tempest-VolumesTransfersTest-670376260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0a55bba5-6d50-4d4e-9e22-b284fd3d8c04 tempest-VolumesTransfersTest-670376260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0a55bba5-6d50-4d4e-9e22-b284fd3d8c04 tempest-VolumesTransfersTest-670376260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0a55bba5-6d50-4d4e-9e22-b284fd3d8c04 tempest-VolumesTransfersTest-670376260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0a55bba5-6d50-4d4e-9e22-b284fd3d8c04 tempest-VolumesTransfersTest-670376260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:24 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:04:24 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:24 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-19067018-6560-4329-9339-a6880b28ce5d" returned: 0 in 0.364s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.871s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-913243065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ae10753-2166-44fc-beae-b9ea526a0eee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac17a81886242feaf82e1a61c77dbb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:22Z,use_quota=True,user_id='0b225ee4e0fd4028a4b8b0e8bef30d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Creating volume 8ae10753-2166-44fc-beae-b9ea526a0eee {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:24 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:04:25 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8ae10753-2166-44fc-beae-b9ea526a0eee 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb7be3b-433c-4321-90ae-7973554e4c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19067018-6560-4329-9339-a6880b28ce5d', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:25 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8ae10753-2166-44fc-beae-b9ea526a0eee 1073741824 Nov 04 19:04:25 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17636b05-5524-43ee-8f24-0762007d527f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:25 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0a55bba5-6d50-4d4e-9e22-b284fd3d8c04 tempest-VolumesTransfersTest-670376260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.283s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-0a55bba5-6d50-4d4e-9e22-b284fd3d8c04 tempest-VolumesTransfersTest-670376260 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:25 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-0a55bba5-6d50-4d4e-9e22-b284fd3d8c04 tempest-VolumesTransfersTest-670376260 None] Deleted volume successfully. Nov 04 19:04:25 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Volume volume-19067018-6560-4329-9339-a6880b28ce5d (19067018-6560-4329-9339-a6880b28ce5d): created successfully Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17636b05-5524-43ee-8f24-0762007d527f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Flow 'volume_create_manager' (d67164c4-d169-4410-8fc4-96176dcbd477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0a55bba5-6d50-4d4e-9e22-b284fd3d8c04 tempest-VolumesTransfersTest-670376260 None] Lock "cinder-781a81b5-9bac-4cf7-a64e-020fcb4ca629-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:25 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-edd6e5c1-d2a2-4a0d-9996-2aef3bd57401 tempest-CreateVolumesFromImageTest-1823262119 None] Created volume successfully. Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:25 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:04:25 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:25 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.274s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager._thread_info {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread count: 28 {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread info: [<_MainThread(MainThread, started 130247852032128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:04:25 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8ae10753-2166-44fc-beae-b9ea526a0eee 1073741824" returned: 0 in 0.619s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8ae10753-2166-44fc-beae-b9ea526a0eee {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:25 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8ae10753-2166-44fc-beae-b9ea526a0eee Nov 04 19:04:25 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:25 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8ae10753-2166-44fc-beae-b9ea526a0eee" returned: 0 in 0.298s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.413s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-817447742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a3f28a-ad9f-4baa-bc22-9d7ea07e933e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac17a81886242feaf82e1a61c77dbb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:22Z,use_quota=True,user_id='0b225ee4e0fd4028a4b8b0e8bef30d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Creating volume a4a3f28a-ad9f-4baa-bc22-9d7ea07e933e {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:04:25 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:04:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a4a3f28a-ad9f-4baa-bc22-9d7ea07e933e 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:26 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a4a3f28a-ad9f-4baa-bc22-9d7ea07e933e 1073741824 Nov 04 19:04:26 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c93d079-fccd-4001-ae6a-a799b5afcafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ae10753-2166-44fc-beae-b9ea526a0eee', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dedf449f-b1da-46e3-a013-263596fec1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:26 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Volume volume-8ae10753-2166-44fc-beae-b9ea526a0eee (8ae10753-2166-44fc-beae-b9ea526a0eee): created successfully Nov 04 19:04:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dedf449f-b1da-46e3-a013-263596fec1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Flow 'volume_create_manager' (bdb7ea71-d031-4dcc-bc5c-a9f490b07dac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:26 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-19b31e9c-2cce-4c4f-af30-7390dc50058d tempest-CreateVolumesFromImageTest-1823262119 None] Created volume successfully. Nov 04 19:04:26 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a4a3f28a-ad9f-4baa-bc22-9d7ea07e933e 1073741824" returned: 0 in 0.617s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a4a3f28a-ad9f-4baa-bc22-9d7ea07e933e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:26 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a4a3f28a-ad9f-4baa-bc22-9d7ea07e933e Nov 04 19:04:26 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:26 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a4a3f28a-ad9f-4baa-bc22-9d7ea07e933e" returned: 0 in 0.354s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:27 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:04:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b54e5eff-c647-47dd-ab2d-03a6f9a59b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4a3f28a-ad9f-4baa-bc22-9d7ea07e933e', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e541198a-be95-4df8-b75f-ccdf7a0cd79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:27 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Volume volume-a4a3f28a-ad9f-4baa-bc22-9d7ea07e933e (a4a3f28a-ad9f-4baa-bc22-9d7ea07e933e): created successfully Nov 04 19:04:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e541198a-be95-4df8-b75f-ccdf7a0cd79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Flow 'volume_create_manager' (6d9dbc0e-a01d-4a7d-b3bc-a71fa5e15163) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:27 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-03d30fb8-b3e6-4074-841e-94ee97f40b7a tempest-CreateVolumesFromImageTest-1823262119 None] Created volume successfully. Nov 04 19:04:28 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-925d5bbe-d6fe-4907-99ad-f9e8d9b46259 tempest-CreateVolumesFromImageTest-1823262119 None] Acquiring lock "cinder-a4a3f28a-ad9f-4baa-bc22-9d7ea07e933e-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:28 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-925d5bbe-d6fe-4907-99ad-f9e8d9b46259 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "cinder-a4a3f28a-ad9f-4baa-bc22-9d7ea07e933e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:28 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-925d5bbe-d6fe-4907-99ad-f9e8d9b46259 tempest-CreateVolumesFromImageTest-1823262119 None] Acquiring lock "cinder-quobyte-a4a3f28a-ad9f-4baa-bc22-9d7ea07e933e" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:28 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-925d5bbe-d6fe-4907-99ad-f9e8d9b46259 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "cinder-quobyte-a4a3f28a-ad9f-4baa-bc22-9d7ea07e933e" acquired by "delete_volume" :: waited 0.021s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:28 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbae901b-b973-4dc6-90f2-e4c84a5bd191]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-925d5bbe-d6fe-4907-99ad-f9e8d9b46259 tempest-CreateVolumesFromImageTest-1823262119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a4a3f28a-ad9f-4baa-bc22-9d7ea07e933e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:28 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a4a3f28a-ad9f-4baa-bc22-9d7ea07e933e Nov 04 19:04:28 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:28 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-925d5bbe-d6fe-4907-99ad-f9e8d9b46259 tempest-CreateVolumesFromImageTest-1823262119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a4a3f28a-ad9f-4baa-bc22-9d7ea07e933e" returned: 0 in 0.426s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-925d5bbe-d6fe-4907-99ad-f9e8d9b46259 tempest-CreateVolumesFromImageTest-1823262119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a4a3f28a-ad9f-4baa-bc22-9d7ea07e933e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:28 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a4a3f28a-ad9f-4baa-bc22-9d7ea07e933e Nov 04 19:04:28 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:28 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-925d5bbe-d6fe-4907-99ad-f9e8d9b46259 tempest-CreateVolumesFromImageTest-1823262119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-a4a3f28a-ad9f-4baa-bc22-9d7ea07e933e" returned: 0 in 0.269s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:28 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-925d5bbe-d6fe-4907-99ad-f9e8d9b46259 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "cinder-quobyte-a4a3f28a-ad9f-4baa-bc22-9d7ea07e933e" released by "delete_volume" :: held 0.745s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:28 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-925d5bbe-d6fe-4907-99ad-f9e8d9b46259 tempest-CreateVolumesFromImageTest-1823262119 None] Created reservations ['d006e916-bb3f-43cb-91dd-4801892c1961', '9a31f72f-3e4b-4d53-8721-c371e6b0dfd5', '53193520-a9b5-4b1e-9b6f-e9466907786e', 'c6601afd-6480-47e1-883a-5724afb65db5'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-925d5bbe-d6fe-4907-99ad-f9e8d9b46259 tempest-CreateVolumesFromImageTest-1823262119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-925d5bbe-d6fe-4907-99ad-f9e8d9b46259 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-925d5bbe-d6fe-4907-99ad-f9e8d9b46259 tempest-CreateVolumesFromImageTest-1823262119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-925d5bbe-d6fe-4907-99ad-f9e8d9b46259 tempest-CreateVolumesFromImageTest-1823262119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-925d5bbe-d6fe-4907-99ad-f9e8d9b46259 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-925d5bbe-d6fe-4907-99ad-f9e8d9b46259 tempest-CreateVolumesFromImageTest-1823262119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:29 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:04:29 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:29 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5acb239e-67ef-451a-842e-ff872f6f3b40 tempest-CreateVolumesFromImageTest-1823262119 None] Acquiring lock "cinder-8ae10753-2166-44fc-beae-b9ea526a0eee-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:29 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5acb239e-67ef-451a-842e-ff872f6f3b40 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "cinder-8ae10753-2166-44fc-beae-b9ea526a0eee-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:29 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5acb239e-67ef-451a-842e-ff872f6f3b40 tempest-CreateVolumesFromImageTest-1823262119 None] Acquiring lock "cinder-quobyte-8ae10753-2166-44fc-beae-b9ea526a0eee" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:29 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:29 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5acb239e-67ef-451a-842e-ff872f6f3b40 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "cinder-quobyte-8ae10753-2166-44fc-beae-b9ea526a0eee" acquired by "delete_volume" :: waited 0.023s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-925d5bbe-d6fe-4907-99ad-f9e8d9b46259 tempest-CreateVolumesFromImageTest-1823262119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.340s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:29 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-925d5bbe-d6fe-4907-99ad-f9e8d9b46259 tempest-CreateVolumesFromImageTest-1823262119 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:29 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-925d5bbe-d6fe-4907-99ad-f9e8d9b46259 tempest-CreateVolumesFromImageTest-1823262119 None] Deleted volume successfully. Nov 04 19:04:29 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[386a73a8-4bd5-4e69-ab94-a174bfd03432]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5acb239e-67ef-451a-842e-ff872f6f3b40 tempest-CreateVolumesFromImageTest-1823262119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8ae10753-2166-44fc-beae-b9ea526a0eee {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:29 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-925d5bbe-d6fe-4907-99ad-f9e8d9b46259 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "cinder-a4a3f28a-ad9f-4baa-bc22-9d7ea07e933e-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:29 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8ae10753-2166-44fc-beae-b9ea526a0eee Nov 04 19:04:29 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:29 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5acb239e-67ef-451a-842e-ff872f6f3b40 tempest-CreateVolumesFromImageTest-1823262119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8ae10753-2166-44fc-beae-b9ea526a0eee" returned: 0 in 0.433s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5acb239e-67ef-451a-842e-ff872f6f3b40 tempest-CreateVolumesFromImageTest-1823262119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8ae10753-2166-44fc-beae-b9ea526a0eee {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:29 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8ae10753-2166-44fc-beae-b9ea526a0eee Nov 04 19:04:29 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:30 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5acb239e-67ef-451a-842e-ff872f6f3b40 tempest-CreateVolumesFromImageTest-1823262119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-8ae10753-2166-44fc-beae-b9ea526a0eee" returned: 0 in 0.275s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5acb239e-67ef-451a-842e-ff872f6f3b40 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "cinder-quobyte-8ae10753-2166-44fc-beae-b9ea526a0eee" released by "delete_volume" :: held 0.771s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:30 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-5acb239e-67ef-451a-842e-ff872f6f3b40 tempest-CreateVolumesFromImageTest-1823262119 None] Created reservations ['ccfc92c7-e293-469b-83f2-136da033d5e9', '14d0aff8-ca60-4618-ba38-39b7918faa12', '1258f6a2-9d77-4ebb-a08c-87135277b232', '02739a31-e096-44d7-83f8-44a1229db35f'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5acb239e-67ef-451a-842e-ff872f6f3b40 tempest-CreateVolumesFromImageTest-1823262119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5acb239e-67ef-451a-842e-ff872f6f3b40 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:30 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5acb239e-67ef-451a-842e-ff872f6f3b40 tempest-CreateVolumesFromImageTest-1823262119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:30 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5acb239e-67ef-451a-842e-ff872f6f3b40 tempest-CreateVolumesFromImageTest-1823262119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5acb239e-67ef-451a-842e-ff872f6f3b40 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5acb239e-67ef-451a-842e-ff872f6f3b40 tempest-CreateVolumesFromImageTest-1823262119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:30 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:04:30 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9fb2caa9-c5da-4fb8-80cd-6c183f53ef15 tempest-CreateVolumesFromImageTest-1823262119 None] Acquiring lock "cinder-19067018-6560-4329-9339-a6880b28ce5d-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9fb2caa9-c5da-4fb8-80cd-6c183f53ef15 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "cinder-19067018-6560-4329-9339-a6880b28ce5d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9fb2caa9-c5da-4fb8-80cd-6c183f53ef15 tempest-CreateVolumesFromImageTest-1823262119 None] Acquiring lock "cinder-quobyte-19067018-6560-4329-9339-a6880b28ce5d" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9fb2caa9-c5da-4fb8-80cd-6c183f53ef15 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "cinder-quobyte-19067018-6560-4329-9339-a6880b28ce5d" acquired by "delete_volume" :: waited 0.017s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:30 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdd9ce6-0ac0-4074-afbb-2e55217c0875]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9fb2caa9-c5da-4fb8-80cd-6c183f53ef15 tempest-CreateVolumesFromImageTest-1823262119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-19067018-6560-4329-9339-a6880b28ce5d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:30 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5acb239e-67ef-451a-842e-ff872f6f3b40 tempest-CreateVolumesFromImageTest-1823262119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.299s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:30 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-5acb239e-67ef-451a-842e-ff872f6f3b40 tempest-CreateVolumesFromImageTest-1823262119 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:30 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-5acb239e-67ef-451a-842e-ff872f6f3b40 tempest-CreateVolumesFromImageTest-1823262119 None] Deleted volume successfully. Nov 04 19:04:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5acb239e-67ef-451a-842e-ff872f6f3b40 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "cinder-8ae10753-2166-44fc-beae-b9ea526a0eee-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:30 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-19067018-6560-4329-9339-a6880b28ce5d Nov 04 19:04:30 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:31 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9fb2caa9-c5da-4fb8-80cd-6c183f53ef15 tempest-CreateVolumesFromImageTest-1823262119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-19067018-6560-4329-9339-a6880b28ce5d" returned: 0 in 0.394s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9fb2caa9-c5da-4fb8-80cd-6c183f53ef15 tempest-CreateVolumesFromImageTest-1823262119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-19067018-6560-4329-9339-a6880b28ce5d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:31 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-19067018-6560-4329-9339-a6880b28ce5d Nov 04 19:04:31 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:31 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9fb2caa9-c5da-4fb8-80cd-6c183f53ef15 tempest-CreateVolumesFromImageTest-1823262119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-19067018-6560-4329-9339-a6880b28ce5d" returned: 0 in 0.316s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:31 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9fb2caa9-c5da-4fb8-80cd-6c183f53ef15 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "cinder-quobyte-19067018-6560-4329-9339-a6880b28ce5d" released by "delete_volume" :: held 0.767s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:31 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-9fb2caa9-c5da-4fb8-80cd-6c183f53ef15 tempest-CreateVolumesFromImageTest-1823262119 None] Created reservations ['1aa8cab5-4acc-4ee5-8796-feef258bd41d', '5369df58-cded-4275-bf5f-32d08a6daa8a', '7dd43644-52b5-4fab-a3d6-c8fe29888612', '8921403c-5789-4515-bef7-064ad50f47eb'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9fb2caa9-c5da-4fb8-80cd-6c183f53ef15 tempest-CreateVolumesFromImageTest-1823262119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9fb2caa9-c5da-4fb8-80cd-6c183f53ef15 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9fb2caa9-c5da-4fb8-80cd-6c183f53ef15 tempest-CreateVolumesFromImageTest-1823262119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9fb2caa9-c5da-4fb8-80cd-6c183f53ef15 tempest-CreateVolumesFromImageTest-1823262119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9fb2caa9-c5da-4fb8-80cd-6c183f53ef15 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9fb2caa9-c5da-4fb8-80cd-6c183f53ef15 tempest-CreateVolumesFromImageTest-1823262119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:31 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:04:31 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:31 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-210ee7f8-7ac4-4240-a2b0-d2406747c4fc tempest-CreateVolumesFromImageTest-1823262119 None] Acquiring lock "cinder-609e20bf-451f-4a18-88ba-e715d2dccdca-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:31 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9fb2caa9-c5da-4fb8-80cd-6c183f53ef15 tempest-CreateVolumesFromImageTest-1823262119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.288s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:31 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-9fb2caa9-c5da-4fb8-80cd-6c183f53ef15 tempest-CreateVolumesFromImageTest-1823262119 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:31 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-210ee7f8-7ac4-4240-a2b0-d2406747c4fc tempest-CreateVolumesFromImageTest-1823262119 None] Lock "cinder-609e20bf-451f-4a18-88ba-e715d2dccdca-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:31 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-9fb2caa9-c5da-4fb8-80cd-6c183f53ef15 tempest-CreateVolumesFromImageTest-1823262119 None] Deleted volume successfully. Nov 04 19:04:31 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-210ee7f8-7ac4-4240-a2b0-d2406747c4fc tempest-CreateVolumesFromImageTest-1823262119 None] Acquiring lock "cinder-quobyte-609e20bf-451f-4a18-88ba-e715d2dccdca" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:31 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9fb2caa9-c5da-4fb8-80cd-6c183f53ef15 tempest-CreateVolumesFromImageTest-1823262119 None] Lock "cinder-19067018-6560-4329-9339-a6880b28ce5d-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:31 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-210ee7f8-7ac4-4240-a2b0-d2406747c4fc tempest-CreateVolumesFromImageTest-1823262119 None] Lock "cinder-quobyte-609e20bf-451f-4a18-88ba-e715d2dccdca" acquired by "delete_volume" :: waited 0.022s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:31 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bea34a-88c8-42ed-aab2-8a25448ba14f]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-210ee7f8-7ac4-4240-a2b0-d2406747c4fc tempest-CreateVolumesFromImageTest-1823262119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-609e20bf-451f-4a18-88ba-e715d2dccdca {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:32 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-609e20bf-451f-4a18-88ba-e715d2dccdca Nov 04 19:04:32 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:32 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-210ee7f8-7ac4-4240-a2b0-d2406747c4fc tempest-CreateVolumesFromImageTest-1823262119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-609e20bf-451f-4a18-88ba-e715d2dccdca" returned: 0 in 0.440s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-210ee7f8-7ac4-4240-a2b0-d2406747c4fc tempest-CreateVolumesFromImageTest-1823262119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-609e20bf-451f-4a18-88ba-e715d2dccdca {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:32 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-609e20bf-451f-4a18-88ba-e715d2dccdca Nov 04 19:04:32 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Flow 'volume_create_manager' (f7989223-a2ce-4eb2-b5bc-0b4c2fe0ffed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e853fa0f-9221-43ec-9f1e-9754f385f51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e853fa0f-9221-43ec-9f1e-9754f385f51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-82604489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9b4da5b-732d-42f4-b676-bd6b10be5bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='919492d6a082454f991d2738707aa511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:32Z,use_quota=True,user_id='b2bd2dd088384dfaaf26de023d161956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aab3fca7-bc20-4861-8306-6e30b89303ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aab3fca7-bc20-4861-8306-6e30b89303ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53d4767-474d-4a1a-b7c3-0b79bdea27eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53d4767-474d-4a1a-b7c3-0b79bdea27eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9b4da5b-732d-42f4-b676-bd6b10be5bfd', 'volume_name': 'volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b65af53-294a-41e9-bb1e-600594fdcbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b65af53-294a-41e9-bb1e-600594fdcbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661f7f8e-be77-4a2c-85e0-3216890861a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:32 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Volume b9b4da5b-732d-42f4-b676-bd6b10be5bfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd', 'volume_size': 1} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-82604489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9b4da5b-732d-42f4-b676-bd6b10be5bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='919492d6a082454f991d2738707aa511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:32Z,use_quota=True,user_id='b2bd2dd088384dfaaf26de023d161956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Creating volume b9b4da5b-732d-42f4-b676-bd6b10be5bfd {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:04:32 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:32 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd 1073741824 Nov 04 19:04:32 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:32 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-210ee7f8-7ac4-4240-a2b0-d2406747c4fc tempest-CreateVolumesFromImageTest-1823262119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-609e20bf-451f-4a18-88ba-e715d2dccdca" returned: 0 in 0.351s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-210ee7f8-7ac4-4240-a2b0-d2406747c4fc tempest-CreateVolumesFromImageTest-1823262119 None] Lock "cinder-quobyte-609e20bf-451f-4a18-88ba-e715d2dccdca" released by "delete_volume" :: held 0.846s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-210ee7f8-7ac4-4240-a2b0-d2406747c4fc tempest-CreateVolumesFromImageTest-1823262119 None] Created reservations ['f6de80e3-4133-4829-80cc-b92da900e91f', '59cb6362-687e-4419-9f9d-aba93c5a4bda', '07195bba-1e01-4ec7-8842-ad0bd9c35ee7', '686caaea-9e96-430a-b47f-cf5b3c51b11d'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-210ee7f8-7ac4-4240-a2b0-d2406747c4fc tempest-CreateVolumesFromImageTest-1823262119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-210ee7f8-7ac4-4240-a2b0-d2406747c4fc tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-210ee7f8-7ac4-4240-a2b0-d2406747c4fc tempest-CreateVolumesFromImageTest-1823262119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-210ee7f8-7ac4-4240-a2b0-d2406747c4fc tempest-CreateVolumesFromImageTest-1823262119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-210ee7f8-7ac4-4240-a2b0-d2406747c4fc tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-210ee7f8-7ac4-4240-a2b0-d2406747c4fc tempest-CreateVolumesFromImageTest-1823262119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:32 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:04:32 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-971fec61-f5ca-45d2-acfe-5be34dea750d tempest-CreateVolumesFromImageTest-1823262119 None] Acquiring lock "cinder-34a4954e-1488-4761-b14d-7abc07fcb490-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:32 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-971fec61-f5ca-45d2-acfe-5be34dea750d tempest-CreateVolumesFromImageTest-1823262119 None] Lock "cinder-34a4954e-1488-4761-b14d-7abc07fcb490-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:33 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-971fec61-f5ca-45d2-acfe-5be34dea750d tempest-CreateVolumesFromImageTest-1823262119 None] Acquiring lock "cinder-quobyte-34a4954e-1488-4761-b14d-7abc07fcb490" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:33 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-971fec61-f5ca-45d2-acfe-5be34dea750d tempest-CreateVolumesFromImageTest-1823262119 None] Lock "cinder-quobyte-34a4954e-1488-4761-b14d-7abc07fcb490" acquired by "delete_volume" :: waited 0.019s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:33 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5a3fca-3f36-494a-95b2-6bf29308aa67]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-971fec61-f5ca-45d2-acfe-5be34dea750d tempest-CreateVolumesFromImageTest-1823262119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-34a4954e-1488-4761-b14d-7abc07fcb490 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:33 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd 1073741824" returned: 0 in 0.545s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:33 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-210ee7f8-7ac4-4240-a2b0-d2406747c4fc tempest-CreateVolumesFromImageTest-1823262119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.311s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:33 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-210ee7f8-7ac4-4240-a2b0-d2406747c4fc tempest-CreateVolumesFromImageTest-1823262119 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:33 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-210ee7f8-7ac4-4240-a2b0-d2406747c4fc tempest-CreateVolumesFromImageTest-1823262119 None] Deleted volume successfully. Nov 04 19:04:33 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd Nov 04 19:04:33 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:33 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-210ee7f8-7ac4-4240-a2b0-d2406747c4fc tempest-CreateVolumesFromImageTest-1823262119 None] Lock "cinder-609e20bf-451f-4a18-88ba-e715d2dccdca-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:33 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-34a4954e-1488-4761-b14d-7abc07fcb490 Nov 04 19:04:33 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:33 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd" returned: 0 in 0.280s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:04:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661f7f8e-be77-4a2c-85e0-3216890861a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019ea764-1b73-487e-b45d-e6b48fc5bfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:33 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Volume volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd (b9b4da5b-732d-42f4-b676-bd6b10be5bfd): created successfully Nov 04 19:04:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019ea764-1b73-487e-b45d-e6b48fc5bfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Flow 'volume_create_manager' (f7989223-a2ce-4eb2-b5bc-0b4c2fe0ffed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:33 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-1c0b3126-77eb-40ef-af09-7a698681539c tempest-VolumesCloneTest-1822763459 None] Created volume successfully. Nov 04 19:04:33 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-971fec61-f5ca-45d2-acfe-5be34dea750d tempest-CreateVolumesFromImageTest-1823262119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-34a4954e-1488-4761-b14d-7abc07fcb490" returned: 0 in 0.444s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-971fec61-f5ca-45d2-acfe-5be34dea750d tempest-CreateVolumesFromImageTest-1823262119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-34a4954e-1488-4761-b14d-7abc07fcb490 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:33 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-34a4954e-1488-4761-b14d-7abc07fcb490 Nov 04 19:04:33 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:33 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-971fec61-f5ca-45d2-acfe-5be34dea750d tempest-CreateVolumesFromImageTest-1823262119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-34a4954e-1488-4761-b14d-7abc07fcb490" returned: 0 in 0.237s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:33 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-971fec61-f5ca-45d2-acfe-5be34dea750d tempest-CreateVolumesFromImageTest-1823262119 None] Lock "cinder-quobyte-34a4954e-1488-4761-b14d-7abc07fcb490" released by "delete_volume" :: held 0.734s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:33 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-971fec61-f5ca-45d2-acfe-5be34dea750d tempest-CreateVolumesFromImageTest-1823262119 None] Created reservations ['7d178cba-f80a-4037-8ace-d82360a230d5', '6cf9d028-86b8-42a2-b8c6-e727f29bc218', 'f96c9045-d3b8-4b27-a494-21420eac55dd', '9fcf125b-b652-4aba-8d36-c42f1ee464d9'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-971fec61-f5ca-45d2-acfe-5be34dea750d tempest-CreateVolumesFromImageTest-1823262119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-971fec61-f5ca-45d2-acfe-5be34dea750d tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-971fec61-f5ca-45d2-acfe-5be34dea750d tempest-CreateVolumesFromImageTest-1823262119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-971fec61-f5ca-45d2-acfe-5be34dea750d tempest-CreateVolumesFromImageTest-1823262119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-971fec61-f5ca-45d2-acfe-5be34dea750d tempest-CreateVolumesFromImageTest-1823262119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-971fec61-f5ca-45d2-acfe-5be34dea750d tempest-CreateVolumesFromImageTest-1823262119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:33 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:04:33 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:34 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-971fec61-f5ca-45d2-acfe-5be34dea750d tempest-CreateVolumesFromImageTest-1823262119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.253s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:34 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-971fec61-f5ca-45d2-acfe-5be34dea750d tempest-CreateVolumesFromImageTest-1823262119 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:34 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-971fec61-f5ca-45d2-acfe-5be34dea750d tempest-CreateVolumesFromImageTest-1823262119 None] Deleted volume successfully. Nov 04 19:04:34 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-971fec61-f5ca-45d2-acfe-5be34dea750d tempest-CreateVolumesFromImageTest-1823262119 None] Lock "cinder-34a4954e-1488-4761-b14d-7abc07fcb490-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:35 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Flow 'volume_create_manager' (447e2bb9-e887-4062-909c-f0fbe1f46b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f90be1b-d213-4c32-af48-12f07a14af45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f90be1b-d213-4c32-af48-12f07a14af45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-466962781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7487e74-e04f-49bb-8809-8b228afa83af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='919492d6a082454f991d2738707aa511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=b9b4da5b-732d-42f4-b676-bd6b10be5bfd,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:35Z,use_quota=True,user_id='b2bd2dd088384dfaaf26de023d161956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (945d755a-609e-4dcc-a34a-8a7ddc394699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (945d755a-609e-4dcc-a34a-8a7ddc394699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af52c79e-e726-4262-8b8a-09c6f3f5d9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af52c79e-e726-4262-8b8a-09c6f3f5d9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e7487e74-e04f-49bb-8809-8b228afa83af', 'volume_name': 'volume-e7487e74-e04f-49bb-8809-8b228afa83af', 'volume_size': 2, 'source_volid': 'b9b4da5b-732d-42f4-b676-bd6b10be5bfd', 'source_volstatus': 'available'}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c308d4-2995-4e50-9570-61b6b2e40fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c308d4-2995-4e50-9570-61b6b2e40fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f3778a-6317-442d-98a1-5a5b9a5fa9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:35 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Volume e7487e74-e04f-49bb-8809-8b228afa83af: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e7487e74-e04f-49bb-8809-8b228afa83af', 'volume_size': 2, 'source_volid': 'b9b4da5b-732d-42f4-b676-bd6b10be5bfd', 'source_volstatus': 'available'} Nov 04 19:04:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:35 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Cloning volume b9b4da5b-732d-42f4-b676-bd6b10be5bfd to volume e7487e74-e04f-49bb-8809-8b228afa83af Nov 04 19:04:35 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Creating offline snapshot d3cf4d87-66c2-4791-a948-8bd58ba121b7 of volume b9b4da5b-732d-42f4-b676-bd6b10be5bfd {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:04:35 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7fc258-6bd0-49f1-a394-e72935b28bc9]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:35 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd Nov 04 19:04:35 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:35 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd" returned: 0 in 0.415s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.d3cf4d87-66c2-4791-a948-8bd58ba121b7 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:35 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.d3cf4d87-66c2-4791-a948-8bd58ba121b7 1G Nov 04 19:04:35 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:36 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.d3cf4d87-66c2-4791-a948-8bd58ba121b7 1G" returned: 0 in 0.634s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.d3cf4d87-66c2-4791-a948-8bd58ba121b7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:36 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.d3cf4d87-66c2-4791-a948-8bd58ba121b7 Nov 04 19:04:36 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:36 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.d3cf4d87-66c2-4791-a948-8bd58ba121b7" returned: 0 in 0.397s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:36 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.d3cf4d87-66c2-4791-a948-8bd58ba121b7 is being set with open permissions: ugo+rw Nov 04 19:04:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.d3cf4d87-66c2-4791-a948-8bd58ba121b7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:36 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.d3cf4d87-66c2-4791-a948-8bd58ba121b7 Nov 04 19:04:36 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:37 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.d3cf4d87-66c2-4791-a948-8bd58ba121b7" returned: 0 in 0.311s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:37 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.info Nov 04 19:04:37 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:37 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Flow 'volume_create_manager' (cc078310-2b4b-459c-92b6-ad5104a201f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (264112e4-5407-4a62-8acc-1f5f115c4fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:37 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.info" returned: 0 in 0.277s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:37 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.info is being set with open permissions: ugo+rw Nov 04 19:04:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (264112e4-5407-4a62-8acc-1f5f115c4fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-604813298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e08ac58b-b33c-434d-92c9-331ee5b306a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93d39e6c5164407a5ba1ad6ea2cd664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:37Z,use_quota=True,user_id='8c4a450531ac4e3088edba65979edd66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0ed328a-1e86-43cd-9106-7aac2c19e630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:37 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.info Nov 04 19:04:37 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0ed328a-1e86-43cd-9106-7aac2c19e630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a3e22d-f64a-46ae-9492-599cf8ed2f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a3e22d-f64a-46ae-9492-599cf8ed2f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e08ac58b-b33c-434d-92c9-331ee5b306a5', 'volume_name': 'volume-e08ac58b-b33c-434d-92c9-331ee5b306a5', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aaff675-584e-49bf-9925-b3aee6052a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aaff675-584e-49bf-9925-b3aee6052a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6a53c3-6162-4f2e-888d-de8b060e2739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:37 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Volume e08ac58b-b33c-434d-92c9-331ee5b306a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e08ac58b-b33c-434d-92c9-331ee5b306a5', 'volume_size': 1} Nov 04 19:04:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:37 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.info" returned: 0 in 0.238s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:37 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Acquiring lock "cinder-quobyte-e7487e74-e04f-49bb-8809-8b228afa83af" by "_copy_volume_from_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:37 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Lock "cinder-quobyte-e7487e74-e04f-49bb-8809-8b228afa83af" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] snapshot: d3cf4d87-66c2-4791-a948-8bd58ba121b7, volume: e7487e74-e04f-49bb-8809-8b228afa83af, {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:04:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:37 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb471d3-04eb-4446-bbc3-5215ccab10b5]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.d3cf4d87-66c2-4791-a948-8bd58ba121b7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:37 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.d3cf4d87-66c2-4791-a948-8bd58ba121b7 Nov 04 19:04:37 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:38 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.d3cf4d87-66c2-4791-a948-8bd58ba121b7" returned: 0 in 0.383s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:04:38 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ed4f24-fd71-47d5-a2d1-530fc298e849]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:38 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd Nov 04 19:04:38 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:38 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd" returned: 0 in 0.370s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:04:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Creating direct copy from snapshot {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:04:38 devstack cinder-volume[87119]: DEBUG cinder.utils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Path /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e7487e74-e04f-49bb-8809-8b228afa83af not found in is_blk_device check {{(pid=87119) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:04:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e7487e74-e04f-49bb-8809-8b228afa83af {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:38 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e7487e74-e04f-49bb-8809-8b228afa83af Nov 04 19:04:38 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:41 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:41 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Flow 'volume_create_manager' (d515616c-03c0-4837-b7f6-0eb15da26555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:41 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b575a0a1-b630-4b78-bcbf-9b8f91ce6820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:41 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b575a0a1-b630-4b78-bcbf-9b8f91ce6820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3c430e-6c29-4979-870b-5063c5033df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4cd8a2db9764204ac43dfb247fc44fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:41Z,use_quota=True,user_id='4d407a8bab7d4a3c97e5d5f7ce555f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:41 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95513e31-96a2-4dce-ad4b-455854e46f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:41 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95513e31-96a2-4dce-ad4b-455854e46f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:41 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a69e75f-992a-4a19-bb77-27f26a2eb16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:41 devstack cinder-volume[87119]: DEBUG cinder.image.glance [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Creating Keystone auth plugin from conf {{(pid=87119) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 19:04:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a69e75f-992a-4a19-bb77-27f26a2eb16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6b3c430e-6c29-4979-870b-5063c5033df5', 'volume_name': 'volume-6b3c430e-6c29-4979-870b-5063c5033df5', 'volume_size': 1, 'image_id': '4f08f529-ec32-4628-8eaf-2523582c4f7f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f08f529-ec32-4628-8eaf-2523582c4f7f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6f6ebb4382c2b88ee5733af5b2864d74', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b4cd8a2db9764204ac43dfb247fc44fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8d8ee842be01f2d4bd2212daa04a4564142fa530496e5de01ab260f1e6241ddb2d4e66a18eb0d24da6e399746b5fe09296c6266819f97f04db1b8222ea65d0a6', 'id': '4f08f529-ec32-4628-8eaf-2523582c4f7f', 'created_at': datetime.datetime(2026, 11, 4, 18, 4, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 4, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f08f529-ec32-4628-8eaf-2523582c4f7f/file', 'properties': {}}, 'image_service': }' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63c580ec-5530-40ea-8907-f5fcdd59f60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63c580ec-5530-40ea-8907-f5fcdd59f60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:42 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c4ce1ce-0193-4991-a102-320cbf13d237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:42 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Volume 6b3c430e-6c29-4979-870b-5063c5033df5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6b3c430e-6c29-4979-870b-5063c5033df5', 'volume_size': 1, 'image_id': '4f08f529-ec32-4628-8eaf-2523582c4f7f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f08f529-ec32-4628-8eaf-2523582c4f7f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6f6ebb4382c2b88ee5733af5b2864d74', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b4cd8a2db9764204ac43dfb247fc44fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8d8ee842be01f2d4bd2212daa04a4564142fa530496e5de01ab260f1e6241ddb2d4e66a18eb0d24da6e399746b5fe09296c6266819f97f04db1b8222ea65d0a6', 'id': '4f08f529-ec32-4628-8eaf-2523582c4f7f', 'created_at': datetime.datetime(2026, 11, 4, 18, 4, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 4, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f08f529-ec32-4628-8eaf-2523582c4f7f/file', 'properties': {}}, 'image_service': } Nov 04 19:04:42 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Trying to clone 6b3c430e-6c29-4979-870b-5063c5033df5 from image 4f08f529-ec32-4628-8eaf-2523582c4f7f at location (None, [{'url': 'file:///opt/stack/data/glance/images/4f08f529-ec32-4628-8eaf-2523582c4f7f', 'metadata': {}}]). {{(pid=87119) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 19:04:42 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4f08f529-ec32-4628-8eaf-2523582c4f7f_fq0uyoi3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 19:04:42 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Image download 0.00 MB at 0.00 MB/s Nov 04 19:04:42 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d05fb74-a8f8-489c-9a06-2f6114e595e8]: (4, 'raw') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4f08f529-ec32-4628-8eaf-2523582c4f7f_fq0uyoi3devstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:42 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4f08f529-ec32-4628-8eaf-2523582c4f7f_fq0uyoi3devstack@QuobyteHD Nov 04 19:04:42 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:42 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4f08f529-ec32-4628-8eaf-2523582c4f7f_fq0uyoi3devstack@QuobyteHD" returned: 0 in 0.489s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f08f529-ec32-4628-8eaf-2523582c4f7f_fq0uyoi3devstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:43 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f08f529-ec32-4628-8eaf-2523582c4f7f_fq0uyoi3devstack@QuobyteHD Nov 04 19:04:43 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:43 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f08f529-ec32-4628-8eaf-2523582c4f7f_fq0uyoi3devstack@QuobyteHD" returned: 1 in 0.470s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f08f529-ec32-4628-8eaf-2523582c4f7f_fq0uyoi3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:04:43 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Temporary image 4f08f529-ec32-4628-8eaf-2523582c4f7f is fetched for user 4d407a8bab7d4a3c97e5d5f7ce555f10. {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 19:04:43 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f7a33f-6bda-4378-a082-68b23759aae8]: (4, 'raw') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4f08f529-ec32-4628-8eaf-2523582c4f7f_fq0uyoi3devstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:43 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4f08f529-ec32-4628-8eaf-2523582c4f7f_fq0uyoi3devstack@QuobyteHD Nov 04 19:04:43 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:44 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4f08f529-ec32-4628-8eaf-2523582c4f7f_fq0uyoi3devstack@QuobyteHD" returned: 0 in 0.589s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f08f529-ec32-4628-8eaf-2523582c4f7f_fq0uyoi3devstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:44 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f08f529-ec32-4628-8eaf-2523582c4f7f_fq0uyoi3devstack@QuobyteHD Nov 04 19:04:44 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:44 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f08f529-ec32-4628-8eaf-2523582c4f7f_fq0uyoi3devstack@QuobyteHD" returned: 1 in 0.538s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f08f529-ec32-4628-8eaf-2523582c4f7f_fq0uyoi3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:04:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:45 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e7487e74-e04f-49bb-8809-8b228afa83af" returned: 0 in 6.656s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:45 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Image conversion details: src /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd, size 1024.00 MB, duration 6.66 sec, destination /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e7487e74-e04f-49bb-8809-8b228afa83af {{(pid=87119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:04:45 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Converted 1024.00 MB image at 153.83 MB/s Nov 04 19:04:45 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e7487e74-e04f-49bb-8809-8b228afa83af is being set with open permissions: ugo+rw Nov 04 19:04:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e7487e74-e04f-49bb-8809-8b228afa83af {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:45 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e7487e74-e04f-49bb-8809-8b228afa83af Nov 04 19:04:45 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:45 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e7487e74-e04f-49bb-8809-8b228afa83af" returned: 0 in 0.272s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Lock "cinder-quobyte-e7487e74-e04f-49bb-8809-8b228afa83af" released by "_copy_volume_from_snapshot" :: held 7.767s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Acquiring lock "cinder-quobyte-d3cf4d87-66c2-4791-a948-8bd58ba121b7" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Lock "cinder-quobyte-d3cf4d87-66c2-4791-a948-8bd58ba121b7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Deleting offline snapshot d3cf4d87-66c2-4791-a948-8bd58ba121b7 of volume b9b4da5b-732d-42f4-b676-bd6b10be5bfd {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:04:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] snapshot_file for this snap is: volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.d3cf4d87-66c2-4791-a948-8bd58ba121b7 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:04:45 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b26b63d-fb49-4a11-a090-0ab92fd463e8]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.d3cf4d87-66c2-4791-a948-8bd58ba121b7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:45 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.d3cf4d87-66c2-4791-a948-8bd58ba121b7 Nov 04 19:04:45 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:45 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.d3cf4d87-66c2-4791-a948-8bd58ba121b7" returned: 0 in 0.359s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:04:45 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b77965-507e-487d-a71c-c619040ff57c]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:46 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd Nov 04 19:04:46 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:46 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd" returned: 0 in 0.530s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.d3cf4d87-66c2-4791-a948-8bd58ba121b7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:46 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.d3cf4d87-66c2-4791-a948-8bd58ba121b7 Nov 04 19:04:46 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:46 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.d3cf4d87-66c2-4791-a948-8bd58ba121b7" returned: 0 in 0.327s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.d3cf4d87-66c2-4791-a948-8bd58ba121b7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:46 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.d3cf4d87-66c2-4791-a948-8bd58ba121b7 Nov 04 19:04:46 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:47 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd.d3cf4d87-66c2-4791-a948-8bd58ba121b7" returned: 0 in 0.252s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Lock "cinder-quobyte-d3cf4d87-66c2-4791-a948-8bd58ba121b7" released by "_delete_snapshot" :: held 1.574s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.832s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.623s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-604813298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e08ac58b-b33c-434d-92c9-331ee5b306a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93d39e6c5164407a5ba1ad6ea2cd664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:37Z,use_quota=True,user_id='8c4a450531ac4e3088edba65979edd66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Creating volume e08ac58b-b33c-434d-92c9-331ee5b306a5 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:04:47 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:47 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5 1073741824 Nov 04 19:04:47 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f3778a-6317-442d-98a1-5a5b9a5fa9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7487e74-e04f-49bb-8809-8b228afa83af', 'volume_size': 2, 'source_volid': 'b9b4da5b-732d-42f4-b676-bd6b10be5bfd', 'source_volstatus': 'available'}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e1a3040-a58f-4720-a4f1-e0f679cdb3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:47 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Volume volume-e7487e74-e04f-49bb-8809-8b228afa83af (e7487e74-e04f-49bb-8809-8b228afa83af): created successfully Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e1a3040-a58f-4720-a4f1-e0f679cdb3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Flow 'volume_create_manager' (447e2bb9-e887-4062-909c-f0fbe1f46b9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:47 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-f503fe22-0cc4-42f5-8a03-0e1507a34de6 tempest-VolumesCloneTest-1822763459 None] Created volume successfully. Nov 04 19:04:47 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5 1073741824" returned: 0 in 0.418s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:47 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5 Nov 04 19:04:47 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:47 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5" returned: 0 in 0.240s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.096s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3c430e-6c29-4979-870b-5063c5033df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4cd8a2db9764204ac43dfb247fc44fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:41Z,use_quota=True,user_id='4d407a8bab7d4a3c97e5d5f7ce555f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Creating volume 6b3c430e-6c29-4979-870b-5063c5033df5 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:04:47 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b3c430e-6c29-4979-870b-5063c5033df5 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6a53c3-6162-4f2e-888d-de8b060e2739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e08ac58b-b33c-434d-92c9-331ee5b306a5', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:47 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b3c430e-6c29-4979-870b-5063c5033df5 1073741824 Nov 04 19:04:47 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54ecab7d-5a53-4e2d-9375-9e9962d5e19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:47 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Volume volume-e08ac58b-b33c-434d-92c9-331ee5b306a5 (e08ac58b-b33c-434d-92c9-331ee5b306a5): created successfully Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54ecab7d-5a53-4e2d-9375-9e9962d5e19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:47 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Flow 'volume_create_manager' (cc078310-2b4b-459c-92b6-ad5104a201f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:47 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-ab0f5106-73f4-4519-8064-4ee0ddbcf703 tempest-SnapshotDependencyTests-422454813 None] Created volume successfully. Nov 04 19:04:48 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b3c430e-6c29-4979-870b-5063c5033df5 1073741824" returned: 0 in 0.503s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b3c430e-6c29-4979-870b-5063c5033df5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:48 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b3c430e-6c29-4979-870b-5063c5033df5 Nov 04 19:04:48 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1bccf6cc-ad42-4514-abf9-7c9e4a18a438 tempest-VolumesCloneTest-1822763459 None] Acquiring lock "cinder-e7487e74-e04f-49bb-8809-8b228afa83af-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7033707f-fcb1-4abb-8ab1-1d7312812270 tempest-SnapshotDependencyTests-422454813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1bccf6cc-ad42-4514-abf9-7c9e4a18a438 tempest-VolumesCloneTest-1822763459 None] Lock "cinder-e7487e74-e04f-49bb-8809-8b228afa83af-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1bccf6cc-ad42-4514-abf9-7c9e4a18a438 tempest-VolumesCloneTest-1822763459 None] Acquiring lock "cinder-quobyte-e7487e74-e04f-49bb-8809-8b228afa83af" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1bccf6cc-ad42-4514-abf9-7c9e4a18a438 tempest-VolumesCloneTest-1822763459 None] Lock "cinder-quobyte-e7487e74-e04f-49bb-8809-8b228afa83af" acquired by "delete_volume" :: waited 0.014s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:48 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a262d1-afa0-4ebc-9df2-74adf61c8405]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1bccf6cc-ad42-4514-abf9-7c9e4a18a438 tempest-VolumesCloneTest-1822763459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e7487e74-e04f-49bb-8809-8b228afa83af {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:48 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:48 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e7487e74-e04f-49bb-8809-8b228afa83af Nov 04 19:04:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b3c430e-6c29-4979-870b-5063c5033df5" returned: 0 in 0.306s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:48 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:04:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7033707f-fcb1-4abb-8ab1-1d7312812270 tempest-SnapshotDependencyTests-422454813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.201s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-7033707f-fcb1-4abb-8ab1-1d7312812270 tempest-SnapshotDependencyTests-422454813 None] Creating offline snapshot f2eb4798-a943-4a62-98c9-960f7cab6777 of volume e08ac58b-b33c-434d-92c9-331ee5b306a5 {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:04:48 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Attempting download of 4f08f529-ec32-4628-8eaf-2523582c4f7f ((None, [{'url': 'file:///opt/stack/data/glance/images/4f08f529-ec32-4628-8eaf-2523582c4f7f', 'metadata': {}}])) to volume 6b3c430e-6c29-4979-870b-5063c5033df5. {{(pid=87119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 19:04:48 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1be3d2a-0f7c-4aca-af1b-06b45375bea4]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7033707f-fcb1-4abb-8ab1-1d7312812270 tempest-SnapshotDependencyTests-422454813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:48 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[28113b52-6f63-4f94-9142-15e3f9253517]: (4, 'raw') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f08f529-ec32-4628-8eaf-2523582c4f7f_qpyb_aqr {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:48 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5 Nov 04 19:04:48 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:48 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f08f529-ec32-4628-8eaf-2523582c4f7f_qpyb_aqr Nov 04 19:04:48 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:48 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1bccf6cc-ad42-4514-abf9-7c9e4a18a438 tempest-VolumesCloneTest-1822763459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e7487e74-e04f-49bb-8809-8b228afa83af" returned: 0 in 0.382s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1bccf6cc-ad42-4514-abf9-7c9e4a18a438 tempest-VolumesCloneTest-1822763459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e7487e74-e04f-49bb-8809-8b228afa83af {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:48 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e7487e74-e04f-49bb-8809-8b228afa83af Nov 04 19:04:48 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:49 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7033707f-fcb1-4abb-8ab1-1d7312812270 tempest-SnapshotDependencyTests-422454813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5" returned: 0 in 0.386s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7033707f-fcb1-4abb-8ab1-1d7312812270 tempest-SnapshotDependencyTests-422454813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.f2eb4798-a943-4a62-98c9-960f7cab6777 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:49 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:49 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.f2eb4798-a943-4a62-98c9-960f7cab6777 1G Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f08f529-ec32-4628-8eaf-2523582c4f7f_qpyb_aqr" returned: 0 in 0.370s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f08f529-ec32-4628-8eaf-2523582c4f7f_qpyb_aqr {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:49 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:49 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1bccf6cc-ad42-4514-abf9-7c9e4a18a438 tempest-VolumesCloneTest-1822763459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e7487e74-e04f-49bb-8809-8b228afa83af" returned: 0 in 0.252s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1bccf6cc-ad42-4514-abf9-7c9e4a18a438 tempest-VolumesCloneTest-1822763459 None] Lock "cinder-quobyte-e7487e74-e04f-49bb-8809-8b228afa83af" released by "delete_volume" :: held 0.682s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:49 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f08f529-ec32-4628-8eaf-2523582c4f7f_qpyb_aqr Nov 04 19:04:49 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-1bccf6cc-ad42-4514-abf9-7c9e4a18a438 tempest-VolumesCloneTest-1822763459 None] Created reservations ['897d6c8f-4425-4357-9f5c-ef106868189d', '9f2c092c-f23c-4295-b3e1-8eeaf779a180', '7d8fe839-a290-4a2e-8a5c-1cecc86b455c', '151c904b-768c-4569-b6c1-a2970f30884c'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1bccf6cc-ad42-4514-abf9-7c9e4a18a438 tempest-VolumesCloneTest-1822763459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1bccf6cc-ad42-4514-abf9-7c9e4a18a438 tempest-VolumesCloneTest-1822763459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1bccf6cc-ad42-4514-abf9-7c9e4a18a438 tempest-VolumesCloneTest-1822763459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1bccf6cc-ad42-4514-abf9-7c9e4a18a438 tempest-VolumesCloneTest-1822763459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1bccf6cc-ad42-4514-abf9-7c9e4a18a438 tempest-VolumesCloneTest-1822763459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1bccf6cc-ad42-4514-abf9-7c9e4a18a438 tempest-VolumesCloneTest-1822763459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:49 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:04:49 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:49 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f08f529-ec32-4628-8eaf-2523582c4f7f_qpyb_aqr" returned: 1 in 0.337s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f08f529-ec32-4628-8eaf-2523582c4f7f_qpyb_aqr' failed. Not Retrying. {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57f6908-6da0-4df8-a0f3-d60666208bc0]: (4, 'raw') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4f08f529-ec32-4628-8eaf-2523582c4f7f_fq0uyoi3devstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:49 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7033707f-fcb1-4abb-8ab1-1d7312812270 tempest-SnapshotDependencyTests-422454813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.f2eb4798-a943-4a62-98c9-960f7cab6777 1G" returned: 0 in 0.456s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7033707f-fcb1-4abb-8ab1-1d7312812270 tempest-SnapshotDependencyTests-422454813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e08ac58b-b33c-434d-92c9-331ee5b306a5 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.f2eb4798-a943-4a62-98c9-960f7cab6777 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:49 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e08ac58b-b33c-434d-92c9-331ee5b306a5 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.f2eb4798-a943-4a62-98c9-960f7cab6777 Nov 04 19:04:49 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:49 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4f08f529-ec32-4628-8eaf-2523582c4f7f_fq0uyoi3devstack@QuobyteHD Nov 04 19:04:49 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:49 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1bccf6cc-ad42-4514-abf9-7c9e4a18a438 tempest-VolumesCloneTest-1822763459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.283s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-1bccf6cc-ad42-4514-abf9-7c9e4a18a438 tempest-VolumesCloneTest-1822763459 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:49 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-1bccf6cc-ad42-4514-abf9-7c9e4a18a438 tempest-VolumesCloneTest-1822763459 None] Deleted volume successfully. Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1bccf6cc-ad42-4514-abf9-7c9e4a18a438 tempest-VolumesCloneTest-1822763459 None] Lock "cinder-e7487e74-e04f-49bb-8809-8b228afa83af-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-701b6a38-24fd-42d3-9277-30d2d2298b77 tempest-VolumesCloneTest-1822763459 None] Acquiring lock "cinder-b9b4da5b-732d-42f4-b676-bd6b10be5bfd-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-701b6a38-24fd-42d3-9277-30d2d2298b77 tempest-VolumesCloneTest-1822763459 None] Lock "cinder-b9b4da5b-732d-42f4-b676-bd6b10be5bfd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-701b6a38-24fd-42d3-9277-30d2d2298b77 tempest-VolumesCloneTest-1822763459 None] Acquiring lock "cinder-quobyte-b9b4da5b-732d-42f4-b676-bd6b10be5bfd" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-701b6a38-24fd-42d3-9277-30d2d2298b77 tempest-VolumesCloneTest-1822763459 None] Lock "cinder-quobyte-b9b4da5b-732d-42f4-b676-bd6b10be5bfd" acquired by "delete_volume" :: waited 0.020s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:49 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4f08f529-ec32-4628-8eaf-2523582c4f7f_fq0uyoi3devstack@QuobyteHD" returned: 0 in 0.378s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f08f529-ec32-4628-8eaf-2523582c4f7f_fq0uyoi3devstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[917078ef-91cd-4f1d-ae1a-02cd44368a47]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-701b6a38-24fd-42d3-9277-30d2d2298b77 tempest-VolumesCloneTest-1822763459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:49 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7033707f-fcb1-4abb-8ab1-1d7312812270 tempest-SnapshotDependencyTests-422454813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e08ac58b-b33c-434d-92c9-331ee5b306a5 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.f2eb4798-a943-4a62-98c9-960f7cab6777" returned: 0 in 0.329s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:49 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-7033707f-fcb1-4abb-8ab1-1d7312812270 tempest-SnapshotDependencyTests-422454813 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.f2eb4798-a943-4a62-98c9-960f7cab6777 is being set with open permissions: ugo+rw Nov 04 19:04:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7033707f-fcb1-4abb-8ab1-1d7312812270 tempest-SnapshotDependencyTests-422454813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.f2eb4798-a943-4a62-98c9-960f7cab6777 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:49 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.f2eb4798-a943-4a62-98c9-960f7cab6777 Nov 04 19:04:49 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:49 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f08f529-ec32-4628-8eaf-2523582c4f7f_fq0uyoi3devstack@QuobyteHD Nov 04 19:04:49 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:49 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd Nov 04 19:04:49 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:50 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7033707f-fcb1-4abb-8ab1-1d7312812270 tempest-SnapshotDependencyTests-422454813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.f2eb4798-a943-4a62-98c9-960f7cab6777" returned: 0 in 0.256s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7033707f-fcb1-4abb-8ab1-1d7312812270 tempest-SnapshotDependencyTests-422454813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:50 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.info Nov 04 19:04:50 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:50 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f08f529-ec32-4628-8eaf-2523582c4f7f_fq0uyoi3devstack@QuobyteHD" returned: 1 in 0.360s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f08f529-ec32-4628-8eaf-2523582c4f7f_fq0uyoi3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:04:50 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] 4f08f529-ec32-4628-8eaf-2523582c4f7f was raw, converting to qcow2 {{(pid=87119) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 19:04:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4f08f529-ec32-4628-8eaf-2523582c4f7f_fq0uyoi3devstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b3c430e-6c29-4979-870b-5063c5033df5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:50 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4f08f529-ec32-4628-8eaf-2523582c4f7f_fq0uyoi3devstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b3c430e-6c29-4979-870b-5063c5033df5 Nov 04 19:04:50 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:50 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-701b6a38-24fd-42d3-9277-30d2d2298b77 tempest-VolumesCloneTest-1822763459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd" returned: 0 in 0.400s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-701b6a38-24fd-42d3-9277-30d2d2298b77 tempest-VolumesCloneTest-1822763459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:50 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd Nov 04 19:04:50 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:50 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7033707f-fcb1-4abb-8ab1-1d7312812270 tempest-SnapshotDependencyTests-422454813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.info" returned: 0 in 0.259s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:50 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-7033707f-fcb1-4abb-8ab1-1d7312812270 tempest-SnapshotDependencyTests-422454813 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.info is being set with open permissions: ugo+rw Nov 04 19:04:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7033707f-fcb1-4abb-8ab1-1d7312812270 tempest-SnapshotDependencyTests-422454813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:50 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.info Nov 04 19:04:50 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:50 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-701b6a38-24fd-42d3-9277-30d2d2298b77 tempest-VolumesCloneTest-1822763459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9b4da5b-732d-42f4-b676-bd6b10be5bfd" returned: 0 in 0.256s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:50 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-701b6a38-24fd-42d3-9277-30d2d2298b77 tempest-VolumesCloneTest-1822763459 None] Lock "cinder-quobyte-b9b4da5b-732d-42f4-b676-bd6b10be5bfd" released by "delete_volume" :: held 0.737s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:50 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-701b6a38-24fd-42d3-9277-30d2d2298b77 tempest-VolumesCloneTest-1822763459 None] Created reservations ['0542a4cf-f42e-4cfc-98a0-e69cffb962d0', '6ff7f022-d614-41a6-a001-e1db788cb296', '31bb47b1-174d-4728-b104-4671b3aa13e5', 'd9ebdb4d-69b3-4e71-b6f5-1bdbe3a75028'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-701b6a38-24fd-42d3-9277-30d2d2298b77 tempest-VolumesCloneTest-1822763459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-701b6a38-24fd-42d3-9277-30d2d2298b77 tempest-VolumesCloneTest-1822763459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:50 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-701b6a38-24fd-42d3-9277-30d2d2298b77 tempest-VolumesCloneTest-1822763459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:50 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-701b6a38-24fd-42d3-9277-30d2d2298b77 tempest-VolumesCloneTest-1822763459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-701b6a38-24fd-42d3-9277-30d2d2298b77 tempest-VolumesCloneTest-1822763459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-701b6a38-24fd-42d3-9277-30d2d2298b77 tempest-VolumesCloneTest-1822763459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:50 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:04:50 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:50 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7033707f-fcb1-4abb-8ab1-1d7312812270 tempest-SnapshotDependencyTests-422454813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.info" returned: 0 in 0.279s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:50 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7033707f-fcb1-4abb-8ab1-1d7312812270 tempest-SnapshotDependencyTests-422454813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.078s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4f08f529-ec32-4628-8eaf-2523582c4f7f_fq0uyoi3devstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b3c430e-6c29-4979-870b-5063c5033df5" returned: 0 in 0.530s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:50 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4f08f529-ec32-4628-8eaf-2523582c4f7f_fq0uyoi3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b3c430e-6c29-4979-870b-5063c5033df5 {{(pid=87119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:04:50 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Converted 0.00 MB image at 0.00 MB/s Nov 04 19:04:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b3c430e-6c29-4979-870b-5063c5033df5 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:50 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b3c430e-6c29-4979-870b-5063c5033df5 1G Nov 04 19:04:50 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:50 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-7033707f-fcb1-4abb-8ab1-1d7312812270 tempest-SnapshotDependencyTests-422454813 None] Create snapshot completed successfully Nov 04 19:04:50 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-701b6a38-24fd-42d3-9277-30d2d2298b77 tempest-VolumesCloneTest-1822763459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.285s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:50 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-701b6a38-24fd-42d3-9277-30d2d2298b77 tempest-VolumesCloneTest-1822763459 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:50 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-701b6a38-24fd-42d3-9277-30d2d2298b77 tempest-VolumesCloneTest-1822763459 None] Deleted volume successfully. Nov 04 19:04:51 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-701b6a38-24fd-42d3-9277-30d2d2298b77 tempest-VolumesCloneTest-1822763459 None] Lock "cinder-b9b4da5b-732d-42f4-b676-bd6b10be5bfd-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:51 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b3c430e-6c29-4979-870b-5063c5033df5 1G" returned: 0 in 0.362s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:51 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Downloaded image 4f08f529-ec32-4628-8eaf-2523582c4f7f ((None, [{'url': 'file:///opt/stack/data/glance/images/4f08f529-ec32-4628-8eaf-2523582c4f7f', 'metadata': {}}])) to volume 6b3c430e-6c29-4979-870b-5063c5033df5 successfully. {{(pid=87119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 19:04:51 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Temporary image 4f08f529-ec32-4628-8eaf-2523582c4f7f for user 4d407a8bab7d4a3c97e5d5f7ce555f10 is deleted. {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 19:04:51 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Marking volume 6b3c430e-6c29-4979-870b-5063c5033df5 as bootable. {{(pid=87119) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 19:04:51 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Copying metadata from image 4f08f529-ec32-4628-8eaf-2523582c4f7f to 6b3c430e-6c29-4979-870b-5063c5033df5. {{(pid=87119) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 19:04:51 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Creating volume glance metadata for volume 6b3c430e-6c29-4979-870b-5063c5033df5 backed by image 4f08f529-ec32-4628-8eaf-2523582c4f7f with: {'image_id': '4f08f529-ec32-4628-8eaf-2523582c4f7f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6f6ebb4382c2b88ee5733af5b2864d74', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87119) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 19:04:51 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c4ce1ce-0193-4991-a102-320cbf13d237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b3c430e-6c29-4979-870b-5063c5033df5', 'volume_size': 1, 'image_id': '4f08f529-ec32-4628-8eaf-2523582c4f7f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f08f529-ec32-4628-8eaf-2523582c4f7f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6f6ebb4382c2b88ee5733af5b2864d74', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b4cd8a2db9764204ac43dfb247fc44fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8d8ee842be01f2d4bd2212daa04a4564142fa530496e5de01ab260f1e6241ddb2d4e66a18eb0d24da6e399746b5fe09296c6266819f97f04db1b8222ea65d0a6', 'id': '4f08f529-ec32-4628-8eaf-2523582c4f7f', 'created_at': datetime.datetime(2026, 11, 4, 18, 4, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 4, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f08f529-ec32-4628-8eaf-2523582c4f7f/file', 'properties': {}}, 'image_service': }' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:51 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15189825-af9c-4770-9d8a-a027487be238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:51 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Volume volume-6b3c430e-6c29-4979-870b-5063c5033df5 (6b3c430e-6c29-4979-870b-5063c5033df5): created successfully Nov 04 19:04:51 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15189825-af9c-4770-9d8a-a027487be238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:51 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Flow 'volume_create_manager' (d515616c-03c0-4837-b7f6-0eb15da26555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:51 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-7eb29367-e8fc-4942-8e96-81d1c59b80da tempest-VolumeImageDependencyTests-1182010692 None] Created volume successfully. Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Flow 'volume_create_manager' (7d129ce3-686a-4649-813d-9ef259a51ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e33f2941-778b-4501-950a-bed1a0faadb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-fe558fd2-a602-4c22-bd6e-30372cae78da tempest-VolumeImageDependencyTests-1182010692 None] Acquiring lock "cinder-6b3c430e-6c29-4979-870b-5063c5033df5-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e33f2941-778b-4501-950a-bed1a0faadb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=806a7bed-2d8b-4089-bc91-7d0de76623bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93d39e6c5164407a5ba1ad6ea2cd664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f2eb4798-a943-4a62-98c9-960f7cab6777,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:52Z,use_quota=True,user_id='8c4a450531ac4e3088edba65979edd66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f33ab9-280b-4191-a5d5-aaf7a40e2b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f33ab9-280b-4191-a5d5-aaf7a40e2b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d81f1e2-3fac-4940-9d85-6aeeb159fd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d81f1e2-3fac-4940-9d85-6aeeb159fd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '806a7bed-2d8b-4089-bc91-7d0de76623bf', 'volume_name': 'volume-806a7bed-2d8b-4089-bc91-7d0de76623bf', 'volume_size': 1, 'snapshot_id': 'f2eb4798-a943-4a62-98c9-960f7cab6777'}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b613ccb7-4212-43b1-a769-ffe4ac852b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b613ccb7-4212-43b1-a769-ffe4ac852b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68fecbbc-5755-4694-a1d3-69ddbec90a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:52 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Volume 806a7bed-2d8b-4089-bc91-7d0de76623bf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-806a7bed-2d8b-4089-bc91-7d0de76623bf', 'volume_size': 1, 'snapshot_id': 'f2eb4798-a943-4a62-98c9-960f7cab6777'} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Acquiring lock "cinder-quobyte-f2eb4798-a943-4a62-98c9-960f7cab6777-806a7bed-2d8b-4089-bc91-7d0de76623bf" by "_create_volume_from_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-fe558fd2-a602-4c22-bd6e-30372cae78da tempest-VolumeImageDependencyTests-1182010692 None] Lock "cinder-6b3c430e-6c29-4979-870b-5063c5033df5-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Lock "cinder-quobyte-f2eb4798-a943-4a62-98c9-960f7cab6777-806a7bed-2d8b-4089-bc91-7d0de76623bf" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Creating volume 806a7bed-2d8b-4089-bc91-7d0de76623bf from snapshot f2eb4798-a943-4a62-98c9-960f7cab6777 {{(pid=87119) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Acquiring lock "cinder-quobyte-806a7bed-2d8b-4089-bc91-7d0de76623bf" by "_copy_volume_from_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Lock "cinder-quobyte-806a7bed-2d8b-4089-bc91-7d0de76623bf" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] snapshot: f2eb4798-a943-4a62-98c9-960f7cab6777, volume: 806a7bed-2d8b-4089-bc91-7d0de76623bf, {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-fe558fd2-a602-4c22-bd6e-30372cae78da tempest-VolumeImageDependencyTests-1182010692 None] Acquiring lock "cinder-quobyte-6b3c430e-6c29-4979-870b-5063c5033df5" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-fe558fd2-a602-4c22-bd6e-30372cae78da tempest-VolumeImageDependencyTests-1182010692 None] Lock "cinder-quobyte-6b3c430e-6c29-4979-870b-5063c5033df5" acquired by "delete_volume" :: waited 0.067s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[733e0f25-db1d-41d0-be1e-a3483274dd11]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.f2eb4798-a943-4a62-98c9-960f7cab6777 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[2317f164-499a-4804-8f99-dcfb2918f1c4]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-fe558fd2-a602-4c22-bd6e-30372cae78da tempest-VolumeImageDependencyTests-1182010692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b3c430e-6c29-4979-870b-5063c5033df5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:52 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.f2eb4798-a943-4a62-98c9-960f7cab6777 Nov 04 19:04:52 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:52 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b3c430e-6c29-4979-870b-5063c5033df5 Nov 04 19:04:52 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:52 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:52 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.f2eb4798-a943-4a62-98c9-960f7cab6777" returned: 0 in 0.396s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e08ac58b-b33c-434d-92c9-331ee5b306a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-fe558fd2-a602-4c22-bd6e-30372cae78da tempest-VolumeImageDependencyTests-1182010692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b3c430e-6c29-4979-870b-5063c5033df5" returned: 0 in 0.378s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-fe558fd2-a602-4c22-bd6e-30372cae78da tempest-VolumeImageDependencyTests-1182010692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b3c430e-6c29-4979-870b-5063c5033df5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2c1463-60e3-4e8b-a8f1-a80cf20b5b06]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:52 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b3c430e-6c29-4979-870b-5063c5033df5 Nov 04 19:04:52 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:53 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5 Nov 04 19:04:53 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:53 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-fe558fd2-a602-4c22-bd6e-30372cae78da tempest-VolumeImageDependencyTests-1182010692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6b3c430e-6c29-4979-870b-5063c5033df5" returned: 0 in 0.284s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:53 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-fe558fd2-a602-4c22-bd6e-30372cae78da tempest-VolumeImageDependencyTests-1182010692 None] Lock "cinder-quobyte-6b3c430e-6c29-4979-870b-5063c5033df5" released by "delete_volume" :: held 0.719s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:53 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-fe558fd2-a602-4c22-bd6e-30372cae78da tempest-VolumeImageDependencyTests-1182010692 None] Created reservations ['2ad117d5-01cf-47af-a4ef-3c10bd9c47f7', '934ecd35-3754-4efb-9e9d-02c78853b684', 'cc7ba9a8-ceab-4eb3-b1a0-da640297891f', '5443fb6a-928e-4361-a7c9-661492bb0ff5'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:53 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5" returned: 0 in 0.401s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:53 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5 {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:04:53 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Creating direct copy from snapshot {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:04:53 devstack cinder-volume[87119]: DEBUG cinder.utils [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Path /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-806a7bed-2d8b-4089-bc91-7d0de76623bf not found in is_blk_device check {{(pid=87119) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:04:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-806a7bed-2d8b-4089-bc91-7d0de76623bf {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:53 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-806a7bed-2d8b-4089-bc91-7d0de76623bf Nov 04 19:04:53 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-fe558fd2-a602-4c22-bd6e-30372cae78da tempest-VolumeImageDependencyTests-1182010692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-fe558fd2-a602-4c22-bd6e-30372cae78da tempest-VolumeImageDependencyTests-1182010692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:53 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-fe558fd2-a602-4c22-bd6e-30372cae78da tempest-VolumeImageDependencyTests-1182010692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:53 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-fe558fd2-a602-4c22-bd6e-30372cae78da tempest-VolumeImageDependencyTests-1182010692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-fe558fd2-a602-4c22-bd6e-30372cae78da tempest-VolumeImageDependencyTests-1182010692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-fe558fd2-a602-4c22-bd6e-30372cae78da tempest-VolumeImageDependencyTests-1182010692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:53 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:04:53 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:53 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-fe558fd2-a602-4c22-bd6e-30372cae78da tempest-VolumeImageDependencyTests-1182010692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.289s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:53 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-fe558fd2-a602-4c22-bd6e-30372cae78da tempest-VolumeImageDependencyTests-1182010692 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:53 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-fe558fd2-a602-4c22-bd6e-30372cae78da tempest-VolumeImageDependencyTests-1182010692 None] Deleted volume successfully. Nov 04 19:04:53 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-fe558fd2-a602-4c22-bd6e-30372cae78da tempest-VolumeImageDependencyTests-1182010692 None] Lock "cinder-6b3c430e-6c29-4979-870b-5063c5033df5-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:56 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Flow 'volume_create_manager' (88f85c61-cefe-45dc-9f6e-df216c653402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c3fe24a-c6cd-4af0-9733-4f0e9214fa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c3fe24a-c6cd-4af0-9733-4f0e9214fa6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-207730503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8e1a4c-5609-471c-941e-155aa1ec4224,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6c9b94256d634c048e70595c1790bfae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:56Z,use_quota=True,user_id='a894f7d99f6c44f7b4ff48a75387b566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5d1e0e-444f-4ff8-bb9b-b46b59df7d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5d1e0e-444f-4ff8-bb9b-b46b59df7d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dec7181-2d12-480e-b495-93662b9ca707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dec7181-2d12-480e-b495-93662b9ca707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e8e1a4c-5609-471c-941e-155aa1ec4224', 'volume_name': 'volume-2e8e1a4c-5609-471c-941e-155aa1ec4224', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23cd0015-663f-4861-a191-56a41b0d5042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23cd0015-663f-4861-a191-56a41b0d5042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d30c2f8-8f3c-4f1c-baeb-0daa907a0b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:56 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Volume 2e8e1a4c-5609-471c-941e-155aa1ec4224: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e8e1a4c-5609-471c-941e-155aa1ec4224', 'volume_size': 1} Nov 04 19:04:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:00 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-806a7bed-2d8b-4089-bc91-7d0de76623bf" returned: 0 in 7.565s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:00 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Image conversion details: src /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5, size 1024.00 MB, duration 7.57 sec, destination /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-806a7bed-2d8b-4089-bc91-7d0de76623bf {{(pid=87119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:05:00 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Converted 1024.00 MB image at 135.35 MB/s Nov 04 19:05:00 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-806a7bed-2d8b-4089-bc91-7d0de76623bf is being set with open permissions: ugo+rw Nov 04 19:05:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-806a7bed-2d8b-4089-bc91-7d0de76623bf {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:00 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-806a7bed-2d8b-4089-bc91-7d0de76623bf Nov 04 19:05:00 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:01 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-806a7bed-2d8b-4089-bc91-7d0de76623bf" returned: 0 in 0.240s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:01 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Lock "cinder-quobyte-806a7bed-2d8b-4089-bc91-7d0de76623bf" released by "_copy_volume_from_snapshot" :: held 8.730s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:01 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Lock "cinder-quobyte-f2eb4798-a943-4a62-98c9-960f7cab6777-806a7bed-2d8b-4089-bc91-7d0de76623bf" released by "_create_volume_from_snapshot" :: held 8.794s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.814s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.601s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:01 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-207730503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8e1a4c-5609-471c-941e-155aa1ec4224,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6c9b94256d634c048e70595c1790bfae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:56Z,use_quota=True,user_id='a894f7d99f6c44f7b4ff48a75387b566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:05:01 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Creating volume 2e8e1a4c-5609-471c-941e-155aa1ec4224 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:05:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:01 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:01 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:01 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:05:01 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:05:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e8e1a4c-5609-471c-941e-155aa1ec4224 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:01 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e8e1a4c-5609-471c-941e-155aa1ec4224 1073741824 Nov 04 19:05:01 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68fecbbc-5755-4694-a1d3-69ddbec90a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-806a7bed-2d8b-4089-bc91-7d0de76623bf', 'volume_size': 1, 'snapshot_id': 'f2eb4798-a943-4a62-98c9-960f7cab6777'}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc962e2d-4bea-46a2-9608-ef0a776fe8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:01 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Volume volume-806a7bed-2d8b-4089-bc91-7d0de76623bf (806a7bed-2d8b-4089-bc91-7d0de76623bf): created successfully Nov 04 19:05:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc962e2d-4bea-46a2-9608-ef0a776fe8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Flow 'volume_create_manager' (7d129ce3-686a-4649-813d-9ef259a51ac6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:01 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-15bced65-3632-4a21-95ff-f38e107e140c tempest-SnapshotDependencyTests-422454813 None] Created volume successfully. Nov 04 19:05:01 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e8e1a4c-5609-471c-941e-155aa1ec4224 1073741824" returned: 0 in 0.457s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e8e1a4c-5609-471c-941e-155aa1ec4224 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:01 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e8e1a4c-5609-471c-941e-155aa1ec4224 Nov 04 19:05:01 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:01 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e8e1a4c-5609-471c-941e-155aa1ec4224" returned: 0 in 0.278s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:01 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:05:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d30c2f8-8f3c-4f1c-baeb-0daa907a0b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e8e1a4c-5609-471c-941e-155aa1ec4224', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (447f7a14-19d1-4f05-b1ad-9c55dac124d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:02 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Volume volume-2e8e1a4c-5609-471c-941e-155aa1ec4224 (2e8e1a4c-5609-471c-941e-155aa1ec4224): created successfully Nov 04 19:05:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (447f7a14-19d1-4f05-b1ad-9c55dac124d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Flow 'volume_create_manager' (88f85c61-cefe-45dc-9f6e-df216c653402) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:02 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-76e7fb61-4727-4022-b60b-b6a84eb8d11f tempest-VolumesGetTest-1225858156 None] Created volume successfully. Nov 04 19:05:02 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ccbcd3fb-f457-4a4f-81d4-44a0c4d5c73a tempest-SnapshotDependencyTests-422454813 None] Acquiring lock "cinder-f2eb4798-a943-4a62-98c9-960f7cab6777-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:02 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ccbcd3fb-f457-4a4f-81d4-44a0c4d5c73a tempest-SnapshotDependencyTests-422454813 None] Lock "cinder-f2eb4798-a943-4a62-98c9-960f7cab6777-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:02 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ccbcd3fb-f457-4a4f-81d4-44a0c4d5c73a tempest-SnapshotDependencyTests-422454813 None] Acquiring lock "cinder-quobyte-e08ac58b-b33c-434d-92c9-331ee5b306a5" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:02 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ccbcd3fb-f457-4a4f-81d4-44a0c4d5c73a tempest-SnapshotDependencyTests-422454813 None] Lock "cinder-quobyte-e08ac58b-b33c-434d-92c9-331ee5b306a5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:02 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ccbcd3fb-f457-4a4f-81d4-44a0c4d5c73a tempest-SnapshotDependencyTests-422454813 None] Acquiring lock "cinder-quobyte-f2eb4798-a943-4a62-98c9-960f7cab6777" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:02 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ccbcd3fb-f457-4a4f-81d4-44a0c4d5c73a tempest-SnapshotDependencyTests-422454813 None] Lock "cinder-quobyte-f2eb4798-a943-4a62-98c9-960f7cab6777" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-ccbcd3fb-f457-4a4f-81d4-44a0c4d5c73a tempest-SnapshotDependencyTests-422454813 None] Deleting offline snapshot f2eb4798-a943-4a62-98c9-960f7cab6777 of volume e08ac58b-b33c-434d-92c9-331ee5b306a5 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:05:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-ccbcd3fb-f457-4a4f-81d4-44a0c4d5c73a tempest-SnapshotDependencyTests-422454813 None] snapshot_file for this snap is: volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.f2eb4798-a943-4a62-98c9-960f7cab6777 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:05:02 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9988ee-43b8-4cea-8a23-c5bdbb6d195a]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ccbcd3fb-f457-4a4f-81d4-44a0c4d5c73a tempest-SnapshotDependencyTests-422454813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.f2eb4798-a943-4a62-98c9-960f7cab6777 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:02 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.f2eb4798-a943-4a62-98c9-960f7cab6777 Nov 04 19:05:02 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:02 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ccbcd3fb-f457-4a4f-81d4-44a0c4d5c73a tempest-SnapshotDependencyTests-422454813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.f2eb4798-a943-4a62-98c9-960f7cab6777" returned: 0 in 0.371s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-ccbcd3fb-f457-4a4f-81d4-44a0c4d5c73a tempest-SnapshotDependencyTests-422454813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e08ac58b-b33c-434d-92c9-331ee5b306a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:05:02 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efe6d6d-3851-40c3-9bd6-010a90001544]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ccbcd3fb-f457-4a4f-81d4-44a0c4d5c73a tempest-SnapshotDependencyTests-422454813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:02 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5 Nov 04 19:05:02 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:03 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ccbcd3fb-f457-4a4f-81d4-44a0c4d5c73a tempest-SnapshotDependencyTests-422454813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5" returned: 0 in 0.550s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ccbcd3fb-f457-4a4f-81d4-44a0c4d5c73a tempest-SnapshotDependencyTests-422454813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.f2eb4798-a943-4a62-98c9-960f7cab6777 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:03 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.f2eb4798-a943-4a62-98c9-960f7cab6777 Nov 04 19:05:03 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:03 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ccbcd3fb-f457-4a4f-81d4-44a0c4d5c73a tempest-SnapshotDependencyTests-422454813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.f2eb4798-a943-4a62-98c9-960f7cab6777" returned: 0 in 0.413s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ccbcd3fb-f457-4a4f-81d4-44a0c4d5c73a tempest-SnapshotDependencyTests-422454813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.f2eb4798-a943-4a62-98c9-960f7cab6777 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:03 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.f2eb4798-a943-4a62-98c9-960f7cab6777 Nov 04 19:05:03 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Flow 'volume_create_manager' (86864239-c22d-4798-acd3-2b21ee9fde62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8982df4c-ef24-4c68-a9dd-8e711a69f31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8982df4c-ef24-4c68-a9dd-8e711a69f31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2065624507',display_name='tempest-VolumesGetTest-Volume-1059817491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aef9f81-5e9d-40db-a3bb-b702e848d6a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9b94256d634c048e70595c1790bfae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:04Z,use_quota=True,user_id='a894f7d99f6c44f7b4ff48a75387b566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b4344d-f684-4fda-9232-5af98b9bf71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b4344d-f684-4fda-9232-5af98b9bf71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234a6dbf-705d-4584-80f5-7a2f6b44afd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234a6dbf-705d-4584-80f5-7a2f6b44afd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aef9f81-5e9d-40db-a3bb-b702e848d6a4', 'volume_name': 'volume-1aef9f81-5e9d-40db-a3bb-b702e848d6a4', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ecbaa4-fbe3-49ae-874b-8ab3f9cda091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ecbaa4-fbe3-49ae-874b-8ab3f9cda091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6217789f-ccee-4c14-924a-7eee15732651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:03 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Volume 1aef9f81-5e9d-40db-a3bb-b702e848d6a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aef9f81-5e9d-40db-a3bb-b702e848d6a4', 'volume_size': 1} Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2065624507',display_name='tempest-VolumesGetTest-Volume-1059817491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aef9f81-5e9d-40db-a3bb-b702e848d6a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9b94256d634c048e70595c1790bfae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:04Z,use_quota=True,user_id='a894f7d99f6c44f7b4ff48a75387b566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Creating volume 1aef9f81-5e9d-40db-a3bb-b702e848d6a4 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:05:03 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1aef9f81-5e9d-40db-a3bb-b702e848d6a4 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:03 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1aef9f81-5e9d-40db-a3bb-b702e848d6a4 1073741824 Nov 04 19:05:03 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:03 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ccbcd3fb-f457-4a4f-81d4-44a0c4d5c73a tempest-SnapshotDependencyTests-422454813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5.f2eb4798-a943-4a62-98c9-960f7cab6777" returned: 0 in 0.288s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ccbcd3fb-f457-4a4f-81d4-44a0c4d5c73a tempest-SnapshotDependencyTests-422454813 None] Lock "cinder-quobyte-f2eb4798-a943-4a62-98c9-960f7cab6777" released by "_delete_snapshot" :: held 1.742s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ccbcd3fb-f457-4a4f-81d4-44a0c4d5c73a tempest-SnapshotDependencyTests-422454813 None] Lock "cinder-quobyte-e08ac58b-b33c-434d-92c9-331ee5b306a5" released by "delete_snapshot" :: held 1.765s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:03 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-ccbcd3fb-f457-4a4f-81d4-44a0c4d5c73a tempest-SnapshotDependencyTests-422454813 None] Created reservations ['b74d013b-e735-4c65-aa3f-0c7474c3298e', '2fb40395-529a-4929-adc3-10537025a9d0', '5e2a0a6d-63cb-4125-9767-b6a27d32e0fc', 'bc3c2222-bd09-49cf-a5ea-3f0f0097f4e3'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:05:04 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-ccbcd3fb-f457-4a4f-81d4-44a0c4d5c73a tempest-SnapshotDependencyTests-422454813 None] Delete snapshot completed successfully. Nov 04 19:05:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-ccbcd3fb-f457-4a4f-81d4-44a0c4d5c73a tempest-SnapshotDependencyTests-422454813 None] Lock "cinder-f2eb4798-a943-4a62-98c9-960f7cab6777-delete_snapshot" released by "delete_snapshot" :: held 1.935s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-192cca0f-7ce9-4a46-93f2-677812c8fb73 tempest-SnapshotDependencyTests-422454813 None] Acquiring lock "cinder-e08ac58b-b33c-434d-92c9-331ee5b306a5-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:04 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1aef9f81-5e9d-40db-a3bb-b702e848d6a4 1073741824" returned: 0 in 0.562s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-192cca0f-7ce9-4a46-93f2-677812c8fb73 tempest-SnapshotDependencyTests-422454813 None] Lock "cinder-e08ac58b-b33c-434d-92c9-331ee5b306a5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-192cca0f-7ce9-4a46-93f2-677812c8fb73 tempest-SnapshotDependencyTests-422454813 None] Acquiring lock "cinder-quobyte-e08ac58b-b33c-434d-92c9-331ee5b306a5" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1aef9f81-5e9d-40db-a3bb-b702e848d6a4 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-192cca0f-7ce9-4a46-93f2-677812c8fb73 tempest-SnapshotDependencyTests-422454813 None] Lock "cinder-quobyte-e08ac58b-b33c-434d-92c9-331ee5b306a5" acquired by "delete_volume" :: waited 0.033s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:04 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1aef9f81-5e9d-40db-a3bb-b702e848d6a4 Nov 04 19:05:04 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:04 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce8aa79-f090-4322-8bae-37d6784a78b2]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-192cca0f-7ce9-4a46-93f2-677812c8fb73 tempest-SnapshotDependencyTests-422454813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:04 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5 Nov 04 19:05:04 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:04 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1aef9f81-5e9d-40db-a3bb-b702e848d6a4" returned: 0 in 0.282s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:04 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:05:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6217789f-ccee-4c14-924a-7eee15732651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aef9f81-5e9d-40db-a3bb-b702e848d6a4', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2f1b22-e58f-49a2-8ef5-1b711eced1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:04 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Volume volume-1aef9f81-5e9d-40db-a3bb-b702e848d6a4 (1aef9f81-5e9d-40db-a3bb-b702e848d6a4): created successfully Nov 04 19:05:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2f1b22-e58f-49a2-8ef5-1b711eced1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Flow 'volume_create_manager' (86864239-c22d-4798-acd3-2b21ee9fde62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:04 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-ff4c6ab8-b514-414b-92b7-b7131b28994d tempest-VolumesGetTest-1225858156 None] Created volume successfully. Nov 04 19:05:04 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-192cca0f-7ce9-4a46-93f2-677812c8fb73 tempest-SnapshotDependencyTests-422454813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5" returned: 0 in 0.463s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-192cca0f-7ce9-4a46-93f2-677812c8fb73 tempest-SnapshotDependencyTests-422454813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:04 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5 Nov 04 19:05:04 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:05 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-192cca0f-7ce9-4a46-93f2-677812c8fb73 tempest-SnapshotDependencyTests-422454813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e08ac58b-b33c-434d-92c9-331ee5b306a5" returned: 0 in 0.247s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-192cca0f-7ce9-4a46-93f2-677812c8fb73 tempest-SnapshotDependencyTests-422454813 None] Lock "cinder-quobyte-e08ac58b-b33c-434d-92c9-331ee5b306a5" released by "delete_volume" :: held 0.808s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:05 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-192cca0f-7ce9-4a46-93f2-677812c8fb73 tempest-SnapshotDependencyTests-422454813 None] Created reservations ['e851a4ba-4cf7-44b1-9732-2dacbf9a1ae2', '58e143a5-cc2a-496d-801b-47a220bc0609', '85faaa68-137f-4f06-af96-cbf9eae4a003', '9e8a8401-8a77-4ffc-9e60-dd3792844358'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:05:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-192cca0f-7ce9-4a46-93f2-677812c8fb73 tempest-SnapshotDependencyTests-422454813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-192cca0f-7ce9-4a46-93f2-677812c8fb73 tempest-SnapshotDependencyTests-422454813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-192cca0f-7ce9-4a46-93f2-677812c8fb73 tempest-SnapshotDependencyTests-422454813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-192cca0f-7ce9-4a46-93f2-677812c8fb73 tempest-SnapshotDependencyTests-422454813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-192cca0f-7ce9-4a46-93f2-677812c8fb73 tempest-SnapshotDependencyTests-422454813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-192cca0f-7ce9-4a46-93f2-677812c8fb73 tempest-SnapshotDependencyTests-422454813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:05 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:05:05 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-65e9f9ea-bbf2-4915-9748-dd3a24aaf8f6 tempest-SnapshotDependencyTests-422454813 None] Acquiring lock "cinder-806a7bed-2d8b-4089-bc91-7d0de76623bf-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-65e9f9ea-bbf2-4915-9748-dd3a24aaf8f6 tempest-SnapshotDependencyTests-422454813 None] Lock "cinder-806a7bed-2d8b-4089-bc91-7d0de76623bf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-65e9f9ea-bbf2-4915-9748-dd3a24aaf8f6 tempest-SnapshotDependencyTests-422454813 None] Acquiring lock "cinder-quobyte-806a7bed-2d8b-4089-bc91-7d0de76623bf" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-65e9f9ea-bbf2-4915-9748-dd3a24aaf8f6 tempest-SnapshotDependencyTests-422454813 None] Lock "cinder-quobyte-806a7bed-2d8b-4089-bc91-7d0de76623bf" acquired by "delete_volume" :: waited 0.020s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:05 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[701b3afd-5aea-462b-ac1e-de7943614fbe]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-65e9f9ea-bbf2-4915-9748-dd3a24aaf8f6 tempest-SnapshotDependencyTests-422454813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-806a7bed-2d8b-4089-bc91-7d0de76623bf {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-192cca0f-7ce9-4a46-93f2-677812c8fb73 tempest-SnapshotDependencyTests-422454813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.321s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:05 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:05 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-192cca0f-7ce9-4a46-93f2-677812c8fb73 tempest-SnapshotDependencyTests-422454813 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:05:05 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-192cca0f-7ce9-4a46-93f2-677812c8fb73 tempest-SnapshotDependencyTests-422454813 None] Deleted volume successfully. Nov 04 19:05:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-192cca0f-7ce9-4a46-93f2-677812c8fb73 tempest-SnapshotDependencyTests-422454813 None] Lock "cinder-e08ac58b-b33c-434d-92c9-331ee5b306a5-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:05 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-806a7bed-2d8b-4089-bc91-7d0de76623bf Nov 04 19:05:05 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-bdca7aaf-7fc9-458c-b337-7ecf96391640 tempest-VolumesGetTest-1225858156 None] Acquiring lock "cinder-1aef9f81-5e9d-40db-a3bb-b702e848d6a4-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-bdca7aaf-7fc9-458c-b337-7ecf96391640 tempest-VolumesGetTest-1225858156 None] Lock "cinder-1aef9f81-5e9d-40db-a3bb-b702e848d6a4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-bdca7aaf-7fc9-458c-b337-7ecf96391640 tempest-VolumesGetTest-1225858156 None] Acquiring lock "cinder-quobyte-1aef9f81-5e9d-40db-a3bb-b702e848d6a4" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-bdca7aaf-7fc9-458c-b337-7ecf96391640 tempest-VolumesGetTest-1225858156 None] Lock "cinder-quobyte-1aef9f81-5e9d-40db-a3bb-b702e848d6a4" acquired by "delete_volume" :: waited 0.017s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:06 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[3778d934-75ce-4056-bfb6-4ad44dece84f]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bdca7aaf-7fc9-458c-b337-7ecf96391640 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1aef9f81-5e9d-40db-a3bb-b702e848d6a4 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:06 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-65e9f9ea-bbf2-4915-9748-dd3a24aaf8f6 tempest-SnapshotDependencyTests-422454813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-806a7bed-2d8b-4089-bc91-7d0de76623bf" returned: 0 in 0.563s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-65e9f9ea-bbf2-4915-9748-dd3a24aaf8f6 tempest-SnapshotDependencyTests-422454813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-806a7bed-2d8b-4089-bc91-7d0de76623bf {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:06 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-806a7bed-2d8b-4089-bc91-7d0de76623bf Nov 04 19:05:06 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:06 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1aef9f81-5e9d-40db-a3bb-b702e848d6a4 Nov 04 19:05:06 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:06 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-65e9f9ea-bbf2-4915-9748-dd3a24aaf8f6 tempest-SnapshotDependencyTests-422454813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-806a7bed-2d8b-4089-bc91-7d0de76623bf" returned: 0 in 0.317s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-65e9f9ea-bbf2-4915-9748-dd3a24aaf8f6 tempest-SnapshotDependencyTests-422454813 None] Lock "cinder-quobyte-806a7bed-2d8b-4089-bc91-7d0de76623bf" released by "delete_volume" :: held 0.950s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:06 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bdca7aaf-7fc9-458c-b337-7ecf96391640 tempest-VolumesGetTest-1225858156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1aef9f81-5e9d-40db-a3bb-b702e848d6a4" returned: 0 in 0.404s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bdca7aaf-7fc9-458c-b337-7ecf96391640 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1aef9f81-5e9d-40db-a3bb-b702e848d6a4 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:06 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-65e9f9ea-bbf2-4915-9748-dd3a24aaf8f6 tempest-SnapshotDependencyTests-422454813 None] Created reservations ['759c15be-9256-427f-8fef-4c6efd5c2974', 'bce8316b-517d-4b8b-a91c-d4caf1f6aae2', '2b694df6-5a73-4a63-8d34-d3eefead5e90', '65dfebf4-21a1-4b03-a86c-6328e8758c63'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:05:06 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1aef9f81-5e9d-40db-a3bb-b702e848d6a4 Nov 04 19:05:06 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-65e9f9ea-bbf2-4915-9748-dd3a24aaf8f6 tempest-SnapshotDependencyTests-422454813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-65e9f9ea-bbf2-4915-9748-dd3a24aaf8f6 tempest-SnapshotDependencyTests-422454813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:06 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-65e9f9ea-bbf2-4915-9748-dd3a24aaf8f6 tempest-SnapshotDependencyTests-422454813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:06 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-65e9f9ea-bbf2-4915-9748-dd3a24aaf8f6 tempest-SnapshotDependencyTests-422454813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-65e9f9ea-bbf2-4915-9748-dd3a24aaf8f6 tempest-SnapshotDependencyTests-422454813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-65e9f9ea-bbf2-4915-9748-dd3a24aaf8f6 tempest-SnapshotDependencyTests-422454813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:06 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:05:06 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:06 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bdca7aaf-7fc9-458c-b337-7ecf96391640 tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1aef9f81-5e9d-40db-a3bb-b702e848d6a4" returned: 0 in 0.379s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-bdca7aaf-7fc9-458c-b337-7ecf96391640 tempest-VolumesGetTest-1225858156 None] Lock "cinder-quobyte-1aef9f81-5e9d-40db-a3bb-b702e848d6a4" released by "delete_volume" :: held 0.849s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:06 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-65e9f9ea-bbf2-4915-9748-dd3a24aaf8f6 tempest-SnapshotDependencyTests-422454813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.310s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:06 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-65e9f9ea-bbf2-4915-9748-dd3a24aaf8f6 tempest-SnapshotDependencyTests-422454813 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:05:06 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-65e9f9ea-bbf2-4915-9748-dd3a24aaf8f6 tempest-SnapshotDependencyTests-422454813 None] Deleted volume successfully. Nov 04 19:05:07 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-bdca7aaf-7fc9-458c-b337-7ecf96391640 tempest-VolumesGetTest-1225858156 None] Created reservations ['41025fc2-af9a-48bd-b0ed-37112fc81def', '542617e8-3f38-412a-8a5c-195f427d1206', 'd7613e90-3a3a-457f-a437-cd6e784801bf', '03ef6db6-d0b6-4608-8ff0-4dd577efde5a'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:05:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-65e9f9ea-bbf2-4915-9748-dd3a24aaf8f6 tempest-SnapshotDependencyTests-422454813 None] Lock "cinder-806a7bed-2d8b-4089-bc91-7d0de76623bf-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bdca7aaf-7fc9-458c-b337-7ecf96391640 tempest-VolumesGetTest-1225858156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bdca7aaf-7fc9-458c-b337-7ecf96391640 tempest-VolumesGetTest-1225858156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bdca7aaf-7fc9-458c-b337-7ecf96391640 tempest-VolumesGetTest-1225858156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bdca7aaf-7fc9-458c-b337-7ecf96391640 tempest-VolumesGetTest-1225858156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bdca7aaf-7fc9-458c-b337-7ecf96391640 tempest-VolumesGetTest-1225858156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bdca7aaf-7fc9-458c-b337-7ecf96391640 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:07 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:05:07 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a242a664-2c6b-4c4c-a2a3-75d30eee1729 tempest-VolumesGetTest-1225858156 None] Acquiring lock "cinder-2e8e1a4c-5609-471c-941e-155aa1ec4224-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a242a664-2c6b-4c4c-a2a3-75d30eee1729 tempest-VolumesGetTest-1225858156 None] Lock "cinder-2e8e1a4c-5609-471c-941e-155aa1ec4224-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a242a664-2c6b-4c4c-a2a3-75d30eee1729 tempest-VolumesGetTest-1225858156 None] Acquiring lock "cinder-quobyte-2e8e1a4c-5609-471c-941e-155aa1ec4224" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a242a664-2c6b-4c4c-a2a3-75d30eee1729 tempest-VolumesGetTest-1225858156 None] Lock "cinder-quobyte-2e8e1a4c-5609-471c-941e-155aa1ec4224" acquired by "delete_volume" :: waited 0.026s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:07 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[736fd968-269a-4753-ae73-51dbcd6730a6]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a242a664-2c6b-4c4c-a2a3-75d30eee1729 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e8e1a4c-5609-471c-941e-155aa1ec4224 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:07 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bdca7aaf-7fc9-458c-b337-7ecf96391640 tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.375s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:07 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-bdca7aaf-7fc9-458c-b337-7ecf96391640 tempest-VolumesGetTest-1225858156 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:05:07 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-bdca7aaf-7fc9-458c-b337-7ecf96391640 tempest-VolumesGetTest-1225858156 None] Deleted volume successfully. Nov 04 19:05:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-bdca7aaf-7fc9-458c-b337-7ecf96391640 tempest-VolumesGetTest-1225858156 None] Lock "cinder-1aef9f81-5e9d-40db-a3bb-b702e848d6a4-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:07 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e8e1a4c-5609-471c-941e-155aa1ec4224 Nov 04 19:05:07 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:07 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a242a664-2c6b-4c4c-a2a3-75d30eee1729 tempest-VolumesGetTest-1225858156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e8e1a4c-5609-471c-941e-155aa1ec4224" returned: 0 in 0.462s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a242a664-2c6b-4c4c-a2a3-75d30eee1729 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e8e1a4c-5609-471c-941e-155aa1ec4224 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:07 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e8e1a4c-5609-471c-941e-155aa1ec4224 Nov 04 19:05:07 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:08 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a242a664-2c6b-4c4c-a2a3-75d30eee1729 tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2e8e1a4c-5609-471c-941e-155aa1ec4224" returned: 0 in 0.259s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a242a664-2c6b-4c4c-a2a3-75d30eee1729 tempest-VolumesGetTest-1225858156 None] Lock "cinder-quobyte-2e8e1a4c-5609-471c-941e-155aa1ec4224" released by "delete_volume" :: held 0.782s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:08 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=139,cinder:INSERT=54,cinder:UPDATE=184,cinder:DELETE=17 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:05:08 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-a242a664-2c6b-4c4c-a2a3-75d30eee1729 tempest-VolumesGetTest-1225858156 None] Created reservations ['ff5f6dba-56ad-4c62-b55c-1738e1679f65', '84402af6-4d6b-4c7f-aa98-53d352f8c4b3', '25715c91-73d2-47c5-9bb0-30c136b11773', '058366f7-f339-42ba-9d46-b387b0b337b9'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:05:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a242a664-2c6b-4c4c-a2a3-75d30eee1729 tempest-VolumesGetTest-1225858156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a242a664-2c6b-4c4c-a2a3-75d30eee1729 tempest-VolumesGetTest-1225858156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a242a664-2c6b-4c4c-a2a3-75d30eee1729 tempest-VolumesGetTest-1225858156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a242a664-2c6b-4c4c-a2a3-75d30eee1729 tempest-VolumesGetTest-1225858156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a242a664-2c6b-4c4c-a2a3-75d30eee1729 tempest-VolumesGetTest-1225858156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a242a664-2c6b-4c4c-a2a3-75d30eee1729 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:08 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:05:08 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:08 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a242a664-2c6b-4c4c-a2a3-75d30eee1729 tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.279s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:08 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-a242a664-2c6b-4c4c-a2a3-75d30eee1729 tempest-VolumesGetTest-1225858156 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:05:08 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-a242a664-2c6b-4c4c-a2a3-75d30eee1729 tempest-VolumesGetTest-1225858156 None] Deleted volume successfully. Nov 04 19:05:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a242a664-2c6b-4c4c-a2a3-75d30eee1729 tempest-VolumesGetTest-1225858156 None] Lock "cinder-2e8e1a4c-5609-471c-941e-155aa1ec4224-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:09 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:05:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Flow 'volume_create_manager' (70bf272d-8e1b-419b-9fc9-1b77d7e8b331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (515a3c3b-ee41-4b2f-839c-9c3b8fdf50e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (515a3c3b-ee41-4b2f-839c-9c3b8fdf50e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1979452045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2734f691-f536-4640-8da9-532a6a4640c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9b94256d634c048e70595c1790bfae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:09Z,use_quota=True,user_id='a894f7d99f6c44f7b4ff48a75387b566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b3d9421-4404-4abd-97ef-f454039a514c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b3d9421-4404-4abd-97ef-f454039a514c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13842f07-7213-4654-be0e-24978a5511b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13842f07-7213-4654-be0e-24978a5511b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2734f691-f536-4640-8da9-532a6a4640c2', 'volume_name': 'volume-2734f691-f536-4640-8da9-532a6a4640c2', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32fe0fe7-2f6b-452a-ad70-864ff3b24103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32fe0fe7-2f6b-452a-ad70-864ff3b24103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5564fc7e-8835-4926-8e6e-2d1b9bdd46d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:09 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Volume 2734f691-f536-4640-8da9-532a6a4640c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2734f691-f536-4640-8da9-532a6a4640c2', 'volume_size': 1} Nov 04 19:05:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1979452045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2734f691-f536-4640-8da9-532a6a4640c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9b94256d634c048e70595c1790bfae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:09Z,use_quota=True,user_id='a894f7d99f6c44f7b4ff48a75387b566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:05:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Creating volume 2734f691-f536-4640-8da9-532a6a4640c2 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:05:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:05:09 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:05:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:09 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2 1073741824 Nov 04 19:05:09 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:09 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2 1073741824" returned: 0 in 0.497s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:09 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2 Nov 04 19:05:09 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:10 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2" returned: 0 in 0.294s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:05:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5564fc7e-8835-4926-8e6e-2d1b9bdd46d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2734f691-f536-4640-8da9-532a6a4640c2', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c82234d-987a-4b7a-bac4-24f55fdf0f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:10 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Volume volume-2734f691-f536-4640-8da9-532a6a4640c2 (2734f691-f536-4640-8da9-532a6a4640c2): created successfully Nov 04 19:05:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c82234d-987a-4b7a-bac4-24f55fdf0f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Flow 'volume_create_manager' (70bf272d-8e1b-419b-9fc9-1b77d7e8b331) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:10 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-0ce4a04a-d0c4-45a5-af6f-4ee7161c6dab tempest-VolumesGetTest-1225858156 None] Created volume successfully. Nov 04 19:05:11 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:UPDATE=184,cinder:SELECT=124,cinder:DELETE=15,cinder:INSERT=44 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:05:11 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:05:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Flow 'volume_create_manager' (f9114186-24fd-4a41-a32a-feae02804da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56564cf-13fd-4581-a898-2730c33cbb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56564cf-13fd-4581-a898-2730c33cbb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-947284053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c159d9-13df-4308-b9da-609fb4b23f90,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6c9b94256d634c048e70595c1790bfae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=2734f691-f536-4640-8da9-532a6a4640c2,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:12Z,use_quota=True,user_id='a894f7d99f6c44f7b4ff48a75387b566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc5dbec7-c413-44cf-83ee-6f76617ff0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc5dbec7-c413-44cf-83ee-6f76617ff0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd4c9fd-c8a7-4125-b804-b47f016f2898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd4c9fd-c8a7-4125-b804-b47f016f2898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '03c159d9-13df-4308-b9da-609fb4b23f90', 'volume_name': 'volume-03c159d9-13df-4308-b9da-609fb4b23f90', 'volume_size': 1, 'source_volid': '2734f691-f536-4640-8da9-532a6a4640c2', 'source_volstatus': 'available'}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb754b6-831e-4b7a-9f43-895bb492a32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb754b6-831e-4b7a-9f43-895bb492a32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a0472e-a481-486e-b3fb-95b0ff3c6c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:11 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Volume 03c159d9-13df-4308-b9da-609fb4b23f90: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-03c159d9-13df-4308-b9da-609fb4b23f90', 'volume_size': 1, 'source_volid': '2734f691-f536-4640-8da9-532a6a4640c2', 'source_volstatus': 'available'} Nov 04 19:05:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:11 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Cloning volume 2734f691-f536-4640-8da9-532a6a4640c2 to volume 03c159d9-13df-4308-b9da-609fb4b23f90 Nov 04 19:05:11 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Creating offline snapshot e3fe309c-1619-4868-b5a0-2397dfa810a9 of volume 2734f691-f536-4640-8da9-532a6a4640c2 {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:05:11 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b869fbe1-c8bf-44a4-a8fe-b73f81020cba]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:12 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2 Nov 04 19:05:12 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:12 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2" returned: 0 in 0.407s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.e3fe309c-1619-4868-b5a0-2397dfa810a9 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:12 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.e3fe309c-1619-4868-b5a0-2397dfa810a9 1G Nov 04 19:05:12 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:12 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.e3fe309c-1619-4868-b5a0-2397dfa810a9 1G" returned: 0 in 0.453s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2734f691-f536-4640-8da9-532a6a4640c2 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.e3fe309c-1619-4868-b5a0-2397dfa810a9 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:12 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2734f691-f536-4640-8da9-532a6a4640c2 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.e3fe309c-1619-4868-b5a0-2397dfa810a9 Nov 04 19:05:12 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:13 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2734f691-f536-4640-8da9-532a6a4640c2 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.e3fe309c-1619-4868-b5a0-2397dfa810a9" returned: 0 in 0.305s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:13 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.e3fe309c-1619-4868-b5a0-2397dfa810a9 is being set with open permissions: ugo+rw Nov 04 19:05:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.e3fe309c-1619-4868-b5a0-2397dfa810a9 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:13 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.e3fe309c-1619-4868-b5a0-2397dfa810a9 Nov 04 19:05:13 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:13 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.e3fe309c-1619-4868-b5a0-2397dfa810a9" returned: 0 in 0.267s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:13 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.info Nov 04 19:05:13 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:13 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.info" returned: 0 in 0.253s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:13 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.info is being set with open permissions: ugo+rw Nov 04 19:05:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:13 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.info Nov 04 19:05:13 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:13 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.info" returned: 0 in 0.280s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:13 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Acquiring lock "cinder-quobyte-03c159d9-13df-4308-b9da-609fb4b23f90" by "_copy_volume_from_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:13 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Lock "cinder-quobyte-03c159d9-13df-4308-b9da-609fb4b23f90" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:13 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] snapshot: e3fe309c-1619-4868-b5a0-2397dfa810a9, volume: 03c159d9-13df-4308-b9da-609fb4b23f90, {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:05:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:13 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:13 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:14 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5a3356-507a-47af-ba92-b6573c1c6296]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.e3fe309c-1619-4868-b5a0-2397dfa810a9 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:14 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.e3fe309c-1619-4868-b5a0-2397dfa810a9 Nov 04 19:05:14 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:14 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.e3fe309c-1619-4868-b5a0-2397dfa810a9" returned: 0 in 0.390s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2734f691-f536-4640-8da9-532a6a4640c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:05:14 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7f2268-344c-490a-869b-6ba765e40ce5]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:14 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2 Nov 04 19:05:14 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:14 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2" returned: 0 in 0.433s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2 {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:05:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Creating direct copy from snapshot {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:05:14 devstack cinder-volume[87119]: DEBUG cinder.utils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Path /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-03c159d9-13df-4308-b9da-609fb4b23f90 not found in is_blk_device check {{(pid=87119) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:05:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-03c159d9-13df-4308-b9da-609fb4b23f90 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:14 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-03c159d9-13df-4308-b9da-609fb4b23f90 Nov 04 19:05:14 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:21 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-03c159d9-13df-4308-b9da-609fb4b23f90" returned: 0 in 6.697s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:21 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Image conversion details: src /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2, size 1024.00 MB, duration 6.70 sec, destination /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-03c159d9-13df-4308-b9da-609fb4b23f90 {{(pid=87119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:05:21 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Converted 1024.00 MB image at 152.88 MB/s Nov 04 19:05:21 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-03c159d9-13df-4308-b9da-609fb4b23f90 is being set with open permissions: ugo+rw Nov 04 19:05:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-03c159d9-13df-4308-b9da-609fb4b23f90 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:21 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-03c159d9-13df-4308-b9da-609fb4b23f90 Nov 04 19:05:21 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:21 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-03c159d9-13df-4308-b9da-609fb4b23f90" returned: 0 in 0.231s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:21 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Lock "cinder-quobyte-03c159d9-13df-4308-b9da-609fb4b23f90" released by "_copy_volume_from_snapshot" :: held 7.836s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:21 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Acquiring lock "cinder-quobyte-e3fe309c-1619-4868-b5a0-2397dfa810a9" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:21 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Lock "cinder-quobyte-e3fe309c-1619-4868-b5a0-2397dfa810a9" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:21 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Deleting offline snapshot e3fe309c-1619-4868-b5a0-2397dfa810a9 of volume 2734f691-f536-4640-8da9-532a6a4640c2 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:05:21 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] snapshot_file for this snap is: volume-2734f691-f536-4640-8da9-532a6a4640c2.e3fe309c-1619-4868-b5a0-2397dfa810a9 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:05:21 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d10a10c-09c5-4d0d-ae5f-82584ab18a54]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.e3fe309c-1619-4868-b5a0-2397dfa810a9 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:21 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.e3fe309c-1619-4868-b5a0-2397dfa810a9 Nov 04 19:05:21 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:22 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.e3fe309c-1619-4868-b5a0-2397dfa810a9" returned: 0 in 0.353s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:22 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2734f691-f536-4640-8da9-532a6a4640c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:05:22 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92ae95c-b192-4b93-8db0-fa77aa5cb32c]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:22 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2 Nov 04 19:05:22 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:22 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2" returned: 0 in 0.518s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.e3fe309c-1619-4868-b5a0-2397dfa810a9 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:22 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.e3fe309c-1619-4868-b5a0-2397dfa810a9 Nov 04 19:05:22 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:23 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.e3fe309c-1619-4868-b5a0-2397dfa810a9" returned: 0 in 0.316s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.e3fe309c-1619-4868-b5a0-2397dfa810a9 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:23 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.e3fe309c-1619-4868-b5a0-2397dfa810a9 Nov 04 19:05:23 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:23 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2.e3fe309c-1619-4868-b5a0-2397dfa810a9" returned: 0 in 0.233s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:23 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Lock "cinder-quobyte-e3fe309c-1619-4868-b5a0-2397dfa810a9" released by "_delete_snapshot" :: held 1.517s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.506s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:23 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a0472e-a481-486e-b3fb-95b0ff3c6c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03c159d9-13df-4308-b9da-609fb4b23f90', 'volume_size': 1, 'source_volid': '2734f691-f536-4640-8da9-532a6a4640c2', 'source_volstatus': 'available'}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:23 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab30c816-119b-4085-ad7c-7ed5154e9d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:23 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Volume volume-03c159d9-13df-4308-b9da-609fb4b23f90 (03c159d9-13df-4308-b9da-609fb4b23f90): created successfully Nov 04 19:05:23 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab30c816-119b-4085-ad7c-7ed5154e9d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:23 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Flow 'volume_create_manager' (f9114186-24fd-4a41-a32a-feae02804da2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:23 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-077bfaf9-1c16-4550-bf33-2a526cf51eb2 tempest-VolumesGetTest-1225858156 None] Created volume successfully. Nov 04 19:05:24 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:05:24 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Flow 'volume_create_manager' (580fc989-58c6-45e9-a613-ad5fe31610b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:24 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b2f788-2822-4788-80fe-2afaa369c2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:24 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b2f788-2822-4788-80fe-2afaa369c2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1155234475',display_name='tempest-VolumesGetTest-Volume-128809375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf88c9a-daea-4f09-be6f-d92ce28be6e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9b94256d634c048e70595c1790bfae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:24Z,use_quota=True,user_id='a894f7d99f6c44f7b4ff48a75387b566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:24 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f18609-3f61-4cb1-a8b5-2b1f41ea9c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:24 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f18609-3f61-4cb1-a8b5-2b1f41ea9c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:24 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (914be16d-e034-488f-906b-6aa92f7baf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:24 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (914be16d-e034-488f-906b-6aa92f7baf0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bf88c9a-daea-4f09-be6f-d92ce28be6e7', 'volume_name': 'volume-2bf88c9a-daea-4f09-be6f-d92ce28be6e7', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:24 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f30a10-4cee-4ed0-b334-37e23ac84817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:24 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f30a10-4cee-4ed0-b334-37e23ac84817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:24 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b290a61d-85d7-417b-8405-31abc6b0ecec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:24 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Volume 2bf88c9a-daea-4f09-be6f-d92ce28be6e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bf88c9a-daea-4f09-be6f-d92ce28be6e7', 'volume_size': 1} Nov 04 19:05:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:24 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1155234475',display_name='tempest-VolumesGetTest-Volume-128809375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf88c9a-daea-4f09-be6f-d92ce28be6e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9b94256d634c048e70595c1790bfae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:24Z,use_quota=True,user_id='a894f7d99f6c44f7b4ff48a75387b566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:05:24 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Creating volume 2bf88c9a-daea-4f09-be6f-d92ce28be6e7 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:05:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:24 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:24 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:24 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:05:24 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:05:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2bf88c9a-daea-4f09-be6f-d92ce28be6e7 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:24 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2bf88c9a-daea-4f09-be6f-d92ce28be6e7 1073741824 Nov 04 19:05:24 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:24 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2bf88c9a-daea-4f09-be6f-d92ce28be6e7 1073741824" returned: 0 in 0.411s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2bf88c9a-daea-4f09-be6f-d92ce28be6e7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:24 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2bf88c9a-daea-4f09-be6f-d92ce28be6e7 Nov 04 19:05:24 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:25 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2bf88c9a-daea-4f09-be6f-d92ce28be6e7" returned: 0 in 0.230s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:05:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b290a61d-85d7-417b-8405-31abc6b0ecec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bf88c9a-daea-4f09-be6f-d92ce28be6e7', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae54cc15-a609-487c-aaab-5b1b37635755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:25 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Volume volume-2bf88c9a-daea-4f09-be6f-d92ce28be6e7 (2bf88c9a-daea-4f09-be6f-d92ce28be6e7): created successfully Nov 04 19:05:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae54cc15-a609-487c-aaab-5b1b37635755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Flow 'volume_create_manager' (580fc989-58c6-45e9-a613-ad5fe31610b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:25 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-5f8f6d02-b4fd-400f-8ec3-938c8918843d tempest-VolumesGetTest-1225858156 None] Created volume successfully. Nov 04 19:05:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:05:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:25 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:05:25 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:25 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0a78ec76-85cf-4d35-ba83-b38667ea759f tempest-VolumesGetTest-1225858156 None] Acquiring lock "cinder-2bf88c9a-daea-4f09-be6f-d92ce28be6e7-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:25 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0a78ec76-85cf-4d35-ba83-b38667ea759f tempest-VolumesGetTest-1225858156 None] Lock "cinder-2bf88c9a-daea-4f09-be6f-d92ce28be6e7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:25 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0a78ec76-85cf-4d35-ba83-b38667ea759f tempest-VolumesGetTest-1225858156 None] Acquiring lock "cinder-quobyte-2bf88c9a-daea-4f09-be6f-d92ce28be6e7" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:25 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.255s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:25 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:05:25 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0a78ec76-85cf-4d35-ba83-b38667ea759f tempest-VolumesGetTest-1225858156 None] Lock "cinder-quobyte-2bf88c9a-daea-4f09-be6f-d92ce28be6e7" acquired by "delete_volume" :: waited 0.016s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager._thread_info {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:05:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread count: 28 {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:05:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread info: [<_MainThread(MainThread, started 130247852032128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:05:25 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b0b74c-c4ac-4c97-86c4-42f31e3ebac3]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0a78ec76-85cf-4d35-ba83-b38667ea759f tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2bf88c9a-daea-4f09-be6f-d92ce28be6e7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:25 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2bf88c9a-daea-4f09-be6f-d92ce28be6e7 Nov 04 19:05:25 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:25 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0a78ec76-85cf-4d35-ba83-b38667ea759f tempest-VolumesGetTest-1225858156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2bf88c9a-daea-4f09-be6f-d92ce28be6e7" returned: 0 in 0.338s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0a78ec76-85cf-4d35-ba83-b38667ea759f tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2bf88c9a-daea-4f09-be6f-d92ce28be6e7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:25 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2bf88c9a-daea-4f09-be6f-d92ce28be6e7 Nov 04 19:05:25 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:26 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0a78ec76-85cf-4d35-ba83-b38667ea759f tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2bf88c9a-daea-4f09-be6f-d92ce28be6e7" returned: 0 in 0.235s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:26 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0a78ec76-85cf-4d35-ba83-b38667ea759f tempest-VolumesGetTest-1225858156 None] Lock "cinder-quobyte-2bf88c9a-daea-4f09-be6f-d92ce28be6e7" released by "delete_volume" :: held 0.613s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:26 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-0a78ec76-85cf-4d35-ba83-b38667ea759f tempest-VolumesGetTest-1225858156 None] Created reservations ['7b4bafed-4cd1-4fdb-bba4-2f7ed8243507', 'd79976ae-dfeb-4ebb-8637-a73328e13193', '55acaf91-6ec2-437e-8ae4-bd9c1bf74b5b', 'f2574f19-68ce-476a-8002-fdc7bc521f8e'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:05:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0a78ec76-85cf-4d35-ba83-b38667ea759f tempest-VolumesGetTest-1225858156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0a78ec76-85cf-4d35-ba83-b38667ea759f tempest-VolumesGetTest-1225858156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0a78ec76-85cf-4d35-ba83-b38667ea759f tempest-VolumesGetTest-1225858156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0a78ec76-85cf-4d35-ba83-b38667ea759f tempest-VolumesGetTest-1225858156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0a78ec76-85cf-4d35-ba83-b38667ea759f tempest-VolumesGetTest-1225858156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0a78ec76-85cf-4d35-ba83-b38667ea759f tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:26 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:05:26 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:26 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0a78ec76-85cf-4d35-ba83-b38667ea759f tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.250s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:26 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-0a78ec76-85cf-4d35-ba83-b38667ea759f tempest-VolumesGetTest-1225858156 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:05:26 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-0a78ec76-85cf-4d35-ba83-b38667ea759f tempest-VolumesGetTest-1225858156 None] Deleted volume successfully. Nov 04 19:05:26 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0a78ec76-85cf-4d35-ba83-b38667ea759f tempest-VolumesGetTest-1225858156 None] Lock "cinder-2bf88c9a-daea-4f09-be6f-d92ce28be6e7-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:26 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4b9e87b1-31ce-45b8-bcbc-a89b8945d73a tempest-VolumesGetTest-1225858156 None] Acquiring lock "cinder-03c159d9-13df-4308-b9da-609fb4b23f90-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:26 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4b9e87b1-31ce-45b8-bcbc-a89b8945d73a tempest-VolumesGetTest-1225858156 None] Lock "cinder-03c159d9-13df-4308-b9da-609fb4b23f90-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:26 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4b9e87b1-31ce-45b8-bcbc-a89b8945d73a tempest-VolumesGetTest-1225858156 None] Acquiring lock "cinder-quobyte-03c159d9-13df-4308-b9da-609fb4b23f90" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:26 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4b9e87b1-31ce-45b8-bcbc-a89b8945d73a tempest-VolumesGetTest-1225858156 None] Lock "cinder-quobyte-03c159d9-13df-4308-b9da-609fb4b23f90" acquired by "delete_volume" :: waited 0.015s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:26 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fca071-93a2-4809-b312-d5eea2e952f3]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4b9e87b1-31ce-45b8-bcbc-a89b8945d73a tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-03c159d9-13df-4308-b9da-609fb4b23f90 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:26 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-03c159d9-13df-4308-b9da-609fb4b23f90 Nov 04 19:05:26 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:27 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4b9e87b1-31ce-45b8-bcbc-a89b8945d73a tempest-VolumesGetTest-1225858156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-03c159d9-13df-4308-b9da-609fb4b23f90" returned: 0 in 0.354s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4b9e87b1-31ce-45b8-bcbc-a89b8945d73a tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-03c159d9-13df-4308-b9da-609fb4b23f90 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:27 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-03c159d9-13df-4308-b9da-609fb4b23f90 Nov 04 19:05:27 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:27 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4b9e87b1-31ce-45b8-bcbc-a89b8945d73a tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-03c159d9-13df-4308-b9da-609fb4b23f90" returned: 0 in 0.234s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:27 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4b9e87b1-31ce-45b8-bcbc-a89b8945d73a tempest-VolumesGetTest-1225858156 None] Lock "cinder-quobyte-03c159d9-13df-4308-b9da-609fb4b23f90" released by "delete_volume" :: held 0.631s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:27 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-4b9e87b1-31ce-45b8-bcbc-a89b8945d73a tempest-VolumesGetTest-1225858156 None] Created reservations ['8516e491-d9d2-4daf-ac3b-520c356bd12e', 'd6b60287-b647-4cb3-ac5d-229f30533c69', '3d6d3f1a-4ea4-438e-b42a-0a0eb64d3bf3', 'b1978e0b-d1d3-45eb-a551-fe267617e941'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:05:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4b9e87b1-31ce-45b8-bcbc-a89b8945d73a tempest-VolumesGetTest-1225858156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4b9e87b1-31ce-45b8-bcbc-a89b8945d73a tempest-VolumesGetTest-1225858156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:27 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4b9e87b1-31ce-45b8-bcbc-a89b8945d73a tempest-VolumesGetTest-1225858156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:27 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4b9e87b1-31ce-45b8-bcbc-a89b8945d73a tempest-VolumesGetTest-1225858156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4b9e87b1-31ce-45b8-bcbc-a89b8945d73a tempest-VolumesGetTest-1225858156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4b9e87b1-31ce-45b8-bcbc-a89b8945d73a tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:27 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:05:27 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:27 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4b9e87b1-31ce-45b8-bcbc-a89b8945d73a tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.237s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:27 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-4b9e87b1-31ce-45b8-bcbc-a89b8945d73a tempest-VolumesGetTest-1225858156 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:05:27 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-4b9e87b1-31ce-45b8-bcbc-a89b8945d73a tempest-VolumesGetTest-1225858156 None] Deleted volume successfully. Nov 04 19:05:27 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4b9e87b1-31ce-45b8-bcbc-a89b8945d73a tempest-VolumesGetTest-1225858156 None] Lock "cinder-03c159d9-13df-4308-b9da-609fb4b23f90-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:27 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-78be30ee-e685-4ae8-99ea-d3f51e78eae6 tempest-VolumesGetTest-1225858156 None] Acquiring lock "cinder-2734f691-f536-4640-8da9-532a6a4640c2-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:27 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-78be30ee-e685-4ae8-99ea-d3f51e78eae6 tempest-VolumesGetTest-1225858156 None] Lock "cinder-2734f691-f536-4640-8da9-532a6a4640c2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:27 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-78be30ee-e685-4ae8-99ea-d3f51e78eae6 tempest-VolumesGetTest-1225858156 None] Acquiring lock "cinder-quobyte-2734f691-f536-4640-8da9-532a6a4640c2" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:27 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-78be30ee-e685-4ae8-99ea-d3f51e78eae6 tempest-VolumesGetTest-1225858156 None] Lock "cinder-quobyte-2734f691-f536-4640-8da9-532a6a4640c2" acquired by "delete_volume" :: waited 0.018s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:28 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc808f3-a4a0-45fe-8cc6-f59f4614fa53]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-78be30ee-e685-4ae8-99ea-d3f51e78eae6 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:28 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2 Nov 04 19:05:28 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:28 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-78be30ee-e685-4ae8-99ea-d3f51e78eae6 tempest-VolumesGetTest-1225858156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2" returned: 0 in 0.354s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-78be30ee-e685-4ae8-99ea-d3f51e78eae6 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:28 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2 Nov 04 19:05:28 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:28 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-78be30ee-e685-4ae8-99ea-d3f51e78eae6 tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2734f691-f536-4640-8da9-532a6a4640c2" returned: 0 in 0.242s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:28 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-78be30ee-e685-4ae8-99ea-d3f51e78eae6 tempest-VolumesGetTest-1225858156 None] Lock "cinder-quobyte-2734f691-f536-4640-8da9-532a6a4640c2" released by "delete_volume" :: held 0.654s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:28 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-78be30ee-e685-4ae8-99ea-d3f51e78eae6 tempest-VolumesGetTest-1225858156 None] Created reservations ['1a53e9e5-e3ec-4579-93d1-921857481fb7', '2086674a-316d-495f-9e4e-857b24552861', '95b2103c-95e3-41b8-81fb-701a6589e5c2', '33a9228a-cb4c-4201-b081-dfdd437a2a88'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:05:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-78be30ee-e685-4ae8-99ea-d3f51e78eae6 tempest-VolumesGetTest-1225858156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-78be30ee-e685-4ae8-99ea-d3f51e78eae6 tempest-VolumesGetTest-1225858156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-78be30ee-e685-4ae8-99ea-d3f51e78eae6 tempest-VolumesGetTest-1225858156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-78be30ee-e685-4ae8-99ea-d3f51e78eae6 tempest-VolumesGetTest-1225858156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-78be30ee-e685-4ae8-99ea-d3f51e78eae6 tempest-VolumesGetTest-1225858156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-78be30ee-e685-4ae8-99ea-d3f51e78eae6 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:28 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:05:28 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:29 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-78be30ee-e685-4ae8-99ea-d3f51e78eae6 tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.254s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:29 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-78be30ee-e685-4ae8-99ea-d3f51e78eae6 tempest-VolumesGetTest-1225858156 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:05:29 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-78be30ee-e685-4ae8-99ea-d3f51e78eae6 tempest-VolumesGetTest-1225858156 None] Deleted volume successfully. Nov 04 19:05:29 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-78be30ee-e685-4ae8-99ea-d3f51e78eae6 tempest-VolumesGetTest-1225858156 None] Lock "cinder-2734f691-f536-4640-8da9-532a6a4640c2-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:29 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:05:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Flow 'volume_create_manager' (58cfef18-bfc2-45c1-9df6-83bd34dff1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f2741a3-1abe-47dc-8ee8-43e8c8e733c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f2741a3-1abe-47dc-8ee8-43e8c8e733c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-299743568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e60092be-0c7b-4299-83b7-a882c0abdf05,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6c9b94256d634c048e70595c1790bfae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:30Z,use_quota=True,user_id='a894f7d99f6c44f7b4ff48a75387b566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85776b07-4886-474a-9806-618d7a405141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85776b07-4886-474a-9806-618d7a405141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a3dcc4-3975-4e30-9abb-1c7e41127df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:29 devstack cinder-volume[87119]: DEBUG cinder.image.glance [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Creating Keystone auth plugin from conf {{(pid=87119) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 19:05:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a3dcc4-3975-4e30-9abb-1c7e41127df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e60092be-0c7b-4299-83b7-a882c0abdf05', 'volume_name': 'volume-e60092be-0c7b-4299-83b7-a882c0abdf05', 'volume_size': 1, 'image_id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '184bff60e125442790f1bc12f0dfbe3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'created_at': datetime.datetime(2026, 11, 4, 17, 42, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d638baf0-7afe-4e9c-96b6-13649eb122ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d638baf0-7afe-4e9c-96b6-13649eb122ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0784e20-2c51-43d8-926a-da698ad799d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:30 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Volume e60092be-0c7b-4299-83b7-a882c0abdf05: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e60092be-0c7b-4299-83b7-a882c0abdf05', 'volume_size': 1, 'image_id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '184bff60e125442790f1bc12f0dfbe3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'created_at': datetime.datetime(2026, 11, 4, 17, 42, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 19:05:30 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Trying to clone e60092be-0c7b-4299-83b7-a882c0abdf05 from image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d at location (None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}]). {{(pid=87119) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 19:05:30 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_r66k6ricdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 19:05:30 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Image download 20.69 MB at 20.69 MB/s Nov 04 19:05:30 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7dd3a8-826f-4558-b3f1-40dfef2988db]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_r66k6ricdevstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:30 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_r66k6ricdevstack@QuobyteHD Nov 04 19:05:30 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:30 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_r66k6ricdevstack@QuobyteHD" returned: 0 in 0.315s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:30 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Temporary image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d is fetched for user a894f7d99f6c44f7b4ff48a75387b566. {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 19:05:30 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[828fc1ee-44cb-405c-9342-6a89d3818031]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_r66k6ricdevstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:30 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_r66k6ricdevstack@QuobyteHD Nov 04 19:05:30 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:31 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_r66k6ricdevstack@QuobyteHD" returned: 0 in 0.311s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-299743568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e60092be-0c7b-4299-83b7-a882c0abdf05,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6c9b94256d634c048e70595c1790bfae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:30Z,use_quota=True,user_id='a894f7d99f6c44f7b4ff48a75387b566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:05:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Creating volume e60092be-0c7b-4299-83b7-a882c0abdf05 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:05:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:05:31 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:05:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e60092be-0c7b-4299-83b7-a882c0abdf05 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:31 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e60092be-0c7b-4299-83b7-a882c0abdf05 1073741824 Nov 04 19:05:31 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:31 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e60092be-0c7b-4299-83b7-a882c0abdf05 1073741824" returned: 0 in 0.384s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e60092be-0c7b-4299-83b7-a882c0abdf05 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:31 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e60092be-0c7b-4299-83b7-a882c0abdf05 Nov 04 19:05:31 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:31 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e60092be-0c7b-4299-83b7-a882c0abdf05" returned: 0 in 0.257s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:05:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:31 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Attempting download of 1353e8e0-d342-427e-a3b6-10b6f6b08d2d ((None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}])) to volume e60092be-0c7b-4299-83b7-a882c0abdf05. {{(pid=87119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 19:05:31 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dcafc6-5dc9-45ce-8960-268efbf6761d]: (4, 'raw') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d__hhj8vp7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:32 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d__hhj8vp7 Nov 04 19:05:32 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:32 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d__hhj8vp7" returned: 0 in 0.312s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d__hhj8vp7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:32 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d__hhj8vp7 Nov 04 19:05:32 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:32 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d__hhj8vp7" returned: 1 in 0.302s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1353e8e0-d342-427e-a3b6-10b6f6b08d2d__hhj8vp7' failed. Not Retrying. {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:05:32 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33c042b-704c-4658-ae8a-afe0109fb11f]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_r66k6ricdevstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:32 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_r66k6ricdevstack@QuobyteHD Nov 04 19:05:32 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:32 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_r66k6ricdevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:32 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] 1353e8e0-d342-427e-a3b6-10b6f6b08d2d was qcow2, converting to qcow2 {{(pid=87119) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 19:05:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_r66k6ricdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e60092be-0c7b-4299-83b7-a882c0abdf05 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:32 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_r66k6ricdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e60092be-0c7b-4299-83b7-a882c0abdf05 Nov 04 19:05:32 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:34 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_r66k6ricdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e60092be-0c7b-4299-83b7-a882c0abdf05" returned: 0 in 1.611s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:34 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1353e8e0-d342-427e-a3b6-10b6f6b08d2d_r66k6ricdevstack@QuobyteHD, size 112.00 MB, duration 1.61 sec, destination /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e60092be-0c7b-4299-83b7-a882c0abdf05 {{(pid=87119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:05:34 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Converted 112.00 MB image at 69.48 MB/s Nov 04 19:05:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e60092be-0c7b-4299-83b7-a882c0abdf05 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:34 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e60092be-0c7b-4299-83b7-a882c0abdf05 1G Nov 04 19:05:34 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:34 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e60092be-0c7b-4299-83b7-a882c0abdf05 1G" returned: 0 in 0.304s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:34 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Downloaded image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d ((None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}])) to volume e60092be-0c7b-4299-83b7-a882c0abdf05 successfully. {{(pid=87119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 19:05:34 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Temporary image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d for user a894f7d99f6c44f7b4ff48a75387b566 is deleted. {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 19:05:34 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Marking volume e60092be-0c7b-4299-83b7-a882c0abdf05 as bootable. {{(pid=87119) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 19:05:34 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Copying metadata from image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d to e60092be-0c7b-4299-83b7-a882c0abdf05. {{(pid=87119) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 19:05:34 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Creating volume glance metadata for volume e60092be-0c7b-4299-83b7-a882c0abdf05 backed by image 1353e8e0-d342-427e-a3b6-10b6f6b08d2d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87119) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 19:05:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0784e20-2c51-43d8-926a-da698ad799d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e60092be-0c7b-4299-83b7-a882c0abdf05', 'volume_size': 1, 'image_id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '184bff60e125442790f1bc12f0dfbe3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1353e8e0-d342-427e-a3b6-10b6f6b08d2d', 'created_at': datetime.datetime(2026, 11, 4, 17, 42, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1353e8e0-d342-427e-a3b6-10b6f6b08d2d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ec9f18-67ea-45bb-adc2-86d081d2820c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:34 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Volume volume-e60092be-0c7b-4299-83b7-a882c0abdf05 (e60092be-0c7b-4299-83b7-a882c0abdf05): created successfully Nov 04 19:05:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ec9f18-67ea-45bb-adc2-86d081d2820c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Flow 'volume_create_manager' (58cfef18-bfc2-45c1-9df6-83bd34dff1a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:34 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e5d5263c-f2ad-409c-a40a-0cb2529e663a tempest-VolumesGetTest-1225858156 None] Created volume successfully. Nov 04 19:05:36 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:05:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Flow 'volume_create_manager' (a8513d60-f577-4b5d-87b5-b75773d76c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b29b860-d016-457c-8e20-b99b2c61bae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b29b860-d016-457c-8e20-b99b2c61bae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1948916097',display_name='tempest-VolumesGetTest-Volume-466489307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b70d05-43f3-4157-8e6b-61f7f1e1297b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9b94256d634c048e70595c1790bfae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:37Z,use_quota=True,user_id='a894f7d99f6c44f7b4ff48a75387b566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c407726c-bc90-4c15-a40f-570b8e31cd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c407726c-bc90-4c15-a40f-570b8e31cd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c121da-b30a-4292-b898-ad8b4ebf6ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c121da-b30a-4292-b898-ad8b4ebf6ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38b70d05-43f3-4157-8e6b-61f7f1e1297b', 'volume_name': 'volume-38b70d05-43f3-4157-8e6b-61f7f1e1297b', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c463295-3575-4569-a7d2-421107553cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c463295-3575-4569-a7d2-421107553cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e891633-ce4c-4ba2-98e9-f81e182afc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:36 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Volume 38b70d05-43f3-4157-8e6b-61f7f1e1297b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38b70d05-43f3-4157-8e6b-61f7f1e1297b', 'volume_size': 1} Nov 04 19:05:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:36 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1948916097',display_name='tempest-VolumesGetTest-Volume-466489307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b70d05-43f3-4157-8e6b-61f7f1e1297b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9b94256d634c048e70595c1790bfae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:37Z,use_quota=True,user_id='a894f7d99f6c44f7b4ff48a75387b566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:05:36 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Creating volume 38b70d05-43f3-4157-8e6b-61f7f1e1297b {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:05:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:36 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:36 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:36 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:05:36 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:05:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38b70d05-43f3-4157-8e6b-61f7f1e1297b 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:36 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38b70d05-43f3-4157-8e6b-61f7f1e1297b 1073741824 Nov 04 19:05:36 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:37 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38b70d05-43f3-4157-8e6b-61f7f1e1297b 1073741824" returned: 0 in 0.409s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38b70d05-43f3-4157-8e6b-61f7f1e1297b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:37 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38b70d05-43f3-4157-8e6b-61f7f1e1297b Nov 04 19:05:37 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:37 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38b70d05-43f3-4157-8e6b-61f7f1e1297b" returned: 0 in 0.260s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:05:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e891633-ce4c-4ba2-98e9-f81e182afc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38b70d05-43f3-4157-8e6b-61f7f1e1297b', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dcf48c2-e1e9-4aea-89dd-87f3a94cba51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:37 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Volume volume-38b70d05-43f3-4157-8e6b-61f7f1e1297b (38b70d05-43f3-4157-8e6b-61f7f1e1297b): created successfully Nov 04 19:05:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dcf48c2-e1e9-4aea-89dd-87f3a94cba51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Flow 'volume_create_manager' (a8513d60-f577-4b5d-87b5-b75773d76c0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:37 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-4ba4df26-d592-43d7-8866-364accc9394c tempest-VolumesGetTest-1225858156 None] Created volume successfully. Nov 04 19:05:37 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9a26a6be-e929-4629-bf8a-c1856dd96554 tempest-VolumesGetTest-1225858156 None] Acquiring lock "cinder-38b70d05-43f3-4157-8e6b-61f7f1e1297b-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:37 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9a26a6be-e929-4629-bf8a-c1856dd96554 tempest-VolumesGetTest-1225858156 None] Lock "cinder-38b70d05-43f3-4157-8e6b-61f7f1e1297b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:37 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9a26a6be-e929-4629-bf8a-c1856dd96554 tempest-VolumesGetTest-1225858156 None] Acquiring lock "cinder-quobyte-38b70d05-43f3-4157-8e6b-61f7f1e1297b" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:37 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9a26a6be-e929-4629-bf8a-c1856dd96554 tempest-VolumesGetTest-1225858156 None] Lock "cinder-quobyte-38b70d05-43f3-4157-8e6b-61f7f1e1297b" acquired by "delete_volume" :: waited 0.016s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:37 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d579c29-b736-4b07-8c8c-33f64ce80c14]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9a26a6be-e929-4629-bf8a-c1856dd96554 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38b70d05-43f3-4157-8e6b-61f7f1e1297b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:38 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38b70d05-43f3-4157-8e6b-61f7f1e1297b Nov 04 19:05:38 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:38 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9a26a6be-e929-4629-bf8a-c1856dd96554 tempest-VolumesGetTest-1225858156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38b70d05-43f3-4157-8e6b-61f7f1e1297b" returned: 0 in 0.359s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9a26a6be-e929-4629-bf8a-c1856dd96554 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38b70d05-43f3-4157-8e6b-61f7f1e1297b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:38 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38b70d05-43f3-4157-8e6b-61f7f1e1297b Nov 04 19:05:38 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:38 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9a26a6be-e929-4629-bf8a-c1856dd96554 tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-38b70d05-43f3-4157-8e6b-61f7f1e1297b" returned: 0 in 0.228s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9a26a6be-e929-4629-bf8a-c1856dd96554 tempest-VolumesGetTest-1225858156 None] Lock "cinder-quobyte-38b70d05-43f3-4157-8e6b-61f7f1e1297b" released by "delete_volume" :: held 0.626s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:38 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-9a26a6be-e929-4629-bf8a-c1856dd96554 tempest-VolumesGetTest-1225858156 None] Created reservations ['fb032d89-859f-441c-b84c-59c3c5b560e2', '0d154656-1048-4b0d-b11a-b5c6d94149ff', '23ab7e36-a52a-4173-b853-d9baf1d1890e', '21488a40-bd98-4ad6-9046-ba0e2a0b7458'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:05:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9a26a6be-e929-4629-bf8a-c1856dd96554 tempest-VolumesGetTest-1225858156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9a26a6be-e929-4629-bf8a-c1856dd96554 tempest-VolumesGetTest-1225858156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9a26a6be-e929-4629-bf8a-c1856dd96554 tempest-VolumesGetTest-1225858156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9a26a6be-e929-4629-bf8a-c1856dd96554 tempest-VolumesGetTest-1225858156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9a26a6be-e929-4629-bf8a-c1856dd96554 tempest-VolumesGetTest-1225858156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9a26a6be-e929-4629-bf8a-c1856dd96554 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:38 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:05:38 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:38 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9a26a6be-e929-4629-bf8a-c1856dd96554 tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.232s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:38 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-9a26a6be-e929-4629-bf8a-c1856dd96554 tempest-VolumesGetTest-1225858156 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:05:38 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-9a26a6be-e929-4629-bf8a-c1856dd96554 tempest-VolumesGetTest-1225858156 None] Deleted volume successfully. Nov 04 19:05:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9a26a6be-e929-4629-bf8a-c1856dd96554 tempest-VolumesGetTest-1225858156 None] Lock "cinder-38b70d05-43f3-4157-8e6b-61f7f1e1297b-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:39 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-8c41a6a6-77e9-46b9-99d0-719482e2cdc8 tempest-VolumesGetTest-1225858156 None] Acquiring lock "cinder-e60092be-0c7b-4299-83b7-a882c0abdf05-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:39 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-8c41a6a6-77e9-46b9-99d0-719482e2cdc8 tempest-VolumesGetTest-1225858156 None] Lock "cinder-e60092be-0c7b-4299-83b7-a882c0abdf05-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:39 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-8c41a6a6-77e9-46b9-99d0-719482e2cdc8 tempest-VolumesGetTest-1225858156 None] Acquiring lock "cinder-quobyte-e60092be-0c7b-4299-83b7-a882c0abdf05" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:39 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-8c41a6a6-77e9-46b9-99d0-719482e2cdc8 tempest-VolumesGetTest-1225858156 None] Lock "cinder-quobyte-e60092be-0c7b-4299-83b7-a882c0abdf05" acquired by "delete_volume" :: waited 0.021s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:39 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b262cb-96ab-468d-83fd-f8a0c4db7f5f]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8c41a6a6-77e9-46b9-99d0-719482e2cdc8 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e60092be-0c7b-4299-83b7-a882c0abdf05 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:39 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e60092be-0c7b-4299-83b7-a882c0abdf05 Nov 04 19:05:39 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:39 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8c41a6a6-77e9-46b9-99d0-719482e2cdc8 tempest-VolumesGetTest-1225858156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e60092be-0c7b-4299-83b7-a882c0abdf05" returned: 0 in 0.345s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8c41a6a6-77e9-46b9-99d0-719482e2cdc8 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e60092be-0c7b-4299-83b7-a882c0abdf05 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:39 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e60092be-0c7b-4299-83b7-a882c0abdf05 Nov 04 19:05:39 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:39 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8c41a6a6-77e9-46b9-99d0-719482e2cdc8 tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e60092be-0c7b-4299-83b7-a882c0abdf05" returned: 0 in 0.230s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:39 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-8c41a6a6-77e9-46b9-99d0-719482e2cdc8 tempest-VolumesGetTest-1225858156 None] Lock "cinder-quobyte-e60092be-0c7b-4299-83b7-a882c0abdf05" released by "delete_volume" :: held 0.620s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:39 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-8c41a6a6-77e9-46b9-99d0-719482e2cdc8 tempest-VolumesGetTest-1225858156 None] Created reservations ['b4aa525b-785b-44b2-a744-927f0d9d2f16', 'bd7fc902-0bb2-447f-81ed-cd5f734832c6', 'b20b2b9a-436b-4e6d-b223-a5f5670c9b1e', 'd922348f-bf44-4cd0-9570-a408d21ce7bb'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:05:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8c41a6a6-77e9-46b9-99d0-719482e2cdc8 tempest-VolumesGetTest-1225858156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8c41a6a6-77e9-46b9-99d0-719482e2cdc8 tempest-VolumesGetTest-1225858156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:39 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8c41a6a6-77e9-46b9-99d0-719482e2cdc8 tempest-VolumesGetTest-1225858156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:39 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8c41a6a6-77e9-46b9-99d0-719482e2cdc8 tempest-VolumesGetTest-1225858156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8c41a6a6-77e9-46b9-99d0-719482e2cdc8 tempest-VolumesGetTest-1225858156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8c41a6a6-77e9-46b9-99d0-719482e2cdc8 tempest-VolumesGetTest-1225858156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:39 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:05:39 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:40 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8c41a6a6-77e9-46b9-99d0-719482e2cdc8 tempest-VolumesGetTest-1225858156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.243s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:40 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-8c41a6a6-77e9-46b9-99d0-719482e2cdc8 tempest-VolumesGetTest-1225858156 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:05:40 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-8c41a6a6-77e9-46b9-99d0-719482e2cdc8 tempest-VolumesGetTest-1225858156 None] Deleted volume successfully. Nov 04 19:05:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-8c41a6a6-77e9-46b9-99d0-719482e2cdc8 tempest-VolumesGetTest-1225858156 None] Lock "cinder-e60092be-0c7b-4299-83b7-a882c0abdf05-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Flow 'volume_create_manager' (5533ae52-29a0-4cee-a942-031d8b69538d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58dfd63c-447c-4853-9ad8-7e70c3cea9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58dfd63c-447c-4853-9ad8-7e70c3cea9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-370589173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f619600-f40f-49a3-9494-6d2d515abd91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ab964e19f749e6b0c9f4d45402098a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:43Z,use_quota=True,user_id='376810252243407aac321c7ed717e0f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b62962d-81f9-45c7-a0f4-487a4ecab512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b62962d-81f9-45c7-a0f4-487a4ecab512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b14ebed1-a02b-484a-bf8a-8a6b08b1ee0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b14ebed1-a02b-484a-bf8a-8a6b08b1ee0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f619600-f40f-49a3-9494-6d2d515abd91', 'volume_name': 'volume-5f619600-f40f-49a3-9494-6d2d515abd91', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4444d639-5599-49e4-ab35-011d522aa95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4444d639-5599-49e4-ab35-011d522aa95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa12927-c071-4f02-8571-50c78ae1558d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:43 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Volume 5f619600-f40f-49a3-9494-6d2d515abd91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f619600-f40f-49a3-9494-6d2d515abd91', 'volume_size': 1} Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-370589173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f619600-f40f-49a3-9494-6d2d515abd91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ab964e19f749e6b0c9f4d45402098a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:43Z,use_quota=True,user_id='376810252243407aac321c7ed717e0f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Creating volume 5f619600-f40f-49a3-9494-6d2d515abd91 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:05:43 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:43 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91 1073741824 Nov 04 19:05:43 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:43 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91 1073741824" returned: 0 in 0.408s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:43 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91 Nov 04 19:05:43 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:43 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91" returned: 0 in 0.227s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa12927-c071-4f02-8571-50c78ae1558d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f619600-f40f-49a3-9494-6d2d515abd91', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (023ebdbd-8c6a-4e1e-8793-328001248e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:43 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Volume volume-5f619600-f40f-49a3-9494-6d2d515abd91 (5f619600-f40f-49a3-9494-6d2d515abd91): created successfully Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (023ebdbd-8c6a-4e1e-8793-328001248e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:43 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Flow 'volume_create_manager' (5533ae52-29a0-4cee-a942-031d8b69538d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:43 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-78606da8-bb3b-496e-8e4a-a731062ec52e tempest-VolumeDependencyTests-1265681919 None] Created volume successfully. Nov 04 19:05:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e742f8e3-eb0d-4834-bf23-918c21db0078 tempest-VolumeDependencyTests-1265681919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e742f8e3-eb0d-4834-bf23-918c21db0078 tempest-VolumeDependencyTests-1265681919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:44 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-e742f8e3-eb0d-4834-bf23-918c21db0078 tempest-VolumeDependencyTests-1265681919 None] Creating offline snapshot ec589857-dded-4f12-a14c-c64cba5f52c8 of volume 5f619600-f40f-49a3-9494-6d2d515abd91 {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:05:44 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[3821753c-3e52-45c5-821c-223fa0df7a4d]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e742f8e3-eb0d-4834-bf23-918c21db0078 tempest-VolumeDependencyTests-1265681919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:44 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91 Nov 04 19:05:44 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:44 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e742f8e3-eb0d-4834-bf23-918c21db0078 tempest-VolumeDependencyTests-1265681919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91" returned: 0 in 0.338s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e742f8e3-eb0d-4834-bf23-918c21db0078 tempest-VolumeDependencyTests-1265681919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.ec589857-dded-4f12-a14c-c64cba5f52c8 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:44 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.ec589857-dded-4f12-a14c-c64cba5f52c8 1G Nov 04 19:05:44 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:44 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e742f8e3-eb0d-4834-bf23-918c21db0078 tempest-VolumeDependencyTests-1265681919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.ec589857-dded-4f12-a14c-c64cba5f52c8 1G" returned: 0 in 0.365s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e742f8e3-eb0d-4834-bf23-918c21db0078 tempest-VolumeDependencyTests-1265681919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f619600-f40f-49a3-9494-6d2d515abd91 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.ec589857-dded-4f12-a14c-c64cba5f52c8 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:45 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f619600-f40f-49a3-9494-6d2d515abd91 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.ec589857-dded-4f12-a14c-c64cba5f52c8 Nov 04 19:05:45 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:45 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e742f8e3-eb0d-4834-bf23-918c21db0078 tempest-VolumeDependencyTests-1265681919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f619600-f40f-49a3-9494-6d2d515abd91 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.ec589857-dded-4f12-a14c-c64cba5f52c8" returned: 0 in 0.280s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:45 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-e742f8e3-eb0d-4834-bf23-918c21db0078 tempest-VolumeDependencyTests-1265681919 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.ec589857-dded-4f12-a14c-c64cba5f52c8 is being set with open permissions: ugo+rw Nov 04 19:05:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e742f8e3-eb0d-4834-bf23-918c21db0078 tempest-VolumeDependencyTests-1265681919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.ec589857-dded-4f12-a14c-c64cba5f52c8 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:45 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.ec589857-dded-4f12-a14c-c64cba5f52c8 Nov 04 19:05:45 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:45 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e742f8e3-eb0d-4834-bf23-918c21db0078 tempest-VolumeDependencyTests-1265681919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.ec589857-dded-4f12-a14c-c64cba5f52c8" returned: 0 in 0.233s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e742f8e3-eb0d-4834-bf23-918c21db0078 tempest-VolumeDependencyTests-1265681919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:45 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.info Nov 04 19:05:45 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:45 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e742f8e3-eb0d-4834-bf23-918c21db0078 tempest-VolumeDependencyTests-1265681919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.info" returned: 0 in 0.245s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:45 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-e742f8e3-eb0d-4834-bf23-918c21db0078 tempest-VolumeDependencyTests-1265681919 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.info is being set with open permissions: ugo+rw Nov 04 19:05:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e742f8e3-eb0d-4834-bf23-918c21db0078 tempest-VolumeDependencyTests-1265681919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:45 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.info Nov 04 19:05:45 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:46 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e742f8e3-eb0d-4834-bf23-918c21db0078 tempest-VolumeDependencyTests-1265681919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.info" returned: 0 in 0.248s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e742f8e3-eb0d-4834-bf23-918c21db0078 tempest-VolumeDependencyTests-1265681919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.798s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:46 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e742f8e3-eb0d-4834-bf23-918c21db0078 tempest-VolumeDependencyTests-1265681919 None] Create snapshot completed successfully Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Flow 'volume_create_manager' (98a012a9-36c8-465b-99cf-b89c58b6c2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35969673-95d8-4d2a-b2bd-af1c2781d2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35969673-95d8-4d2a-b2bd-af1c2781d2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1246898486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1e08b89-b23e-4fca-a6d5-eba471139389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ab964e19f749e6b0c9f4d45402098a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ec589857-dded-4f12-a14c-c64cba5f52c8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:47Z,use_quota=True,user_id='376810252243407aac321c7ed717e0f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (053094aa-0fa3-4e69-b84b-7d16fc68d777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (053094aa-0fa3-4e69-b84b-7d16fc68d777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76713bdc-2a35-4201-9d21-7eb5ebc37951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76713bdc-2a35-4201-9d21-7eb5ebc37951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd1e08b89-b23e-4fca-a6d5-eba471139389', 'volume_name': 'volume-d1e08b89-b23e-4fca-a6d5-eba471139389', 'volume_size': 1, 'snapshot_id': 'ec589857-dded-4f12-a14c-c64cba5f52c8'}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c7e578-ad4c-429b-8eeb-cbd174680a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c7e578-ad4c-429b-8eeb-cbd174680a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f376d3b-1526-459d-8efd-788657250072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:46 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Volume d1e08b89-b23e-4fca-a6d5-eba471139389: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d1e08b89-b23e-4fca-a6d5-eba471139389', 'volume_size': 1, 'snapshot_id': 'ec589857-dded-4f12-a14c-c64cba5f52c8'} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Acquiring lock "cinder-quobyte-ec589857-dded-4f12-a14c-c64cba5f52c8-d1e08b89-b23e-4fca-a6d5-eba471139389" by "_create_volume_from_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Lock "cinder-quobyte-ec589857-dded-4f12-a14c-c64cba5f52c8-d1e08b89-b23e-4fca-a6d5-eba471139389" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Creating volume d1e08b89-b23e-4fca-a6d5-eba471139389 from snapshot ec589857-dded-4f12-a14c-c64cba5f52c8 {{(pid=87119) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Acquiring lock "cinder-quobyte-d1e08b89-b23e-4fca-a6d5-eba471139389" by "_copy_volume_from_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Lock "cinder-quobyte-d1e08b89-b23e-4fca-a6d5-eba471139389" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] snapshot: ec589857-dded-4f12-a14c-c64cba5f52c8, volume: d1e08b89-b23e-4fca-a6d5-eba471139389, {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:47 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e9c6d9-1c85-4e43-95df-f2602ede8614]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.ec589857-dded-4f12-a14c-c64cba5f52c8 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:47 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.ec589857-dded-4f12-a14c-c64cba5f52c8 Nov 04 19:05:47 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:47 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.ec589857-dded-4f12-a14c-c64cba5f52c8" returned: 0 in 0.348s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f619600-f40f-49a3-9494-6d2d515abd91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:05:47 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef83496-b0cc-4d49-b5cd-cb8b428a8f7b]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:47 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91 Nov 04 19:05:47 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:47 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91" returned: 0 in 0.343s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91 {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:05:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Creating direct copy from snapshot {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:05:47 devstack cinder-volume[87119]: DEBUG cinder.utils [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Path /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d1e08b89-b23e-4fca-a6d5-eba471139389 not found in is_blk_device check {{(pid=87119) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:05:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d1e08b89-b23e-4fca-a6d5-eba471139389 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:47 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d1e08b89-b23e-4fca-a6d5-eba471139389 Nov 04 19:05:47 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:53 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d1e08b89-b23e-4fca-a6d5-eba471139389" returned: 0 in 5.690s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:53 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Image conversion details: src /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91, size 1024.00 MB, duration 5.69 sec, destination /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d1e08b89-b23e-4fca-a6d5-eba471139389 {{(pid=87119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:05:53 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Converted 1024.00 MB image at 179.86 MB/s Nov 04 19:05:53 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d1e08b89-b23e-4fca-a6d5-eba471139389 is being set with open permissions: ugo+rw Nov 04 19:05:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d1e08b89-b23e-4fca-a6d5-eba471139389 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:53 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d1e08b89-b23e-4fca-a6d5-eba471139389 Nov 04 19:05:53 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:53 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d1e08b89-b23e-4fca-a6d5-eba471139389" returned: 0 in 0.241s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:53 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Lock "cinder-quobyte-d1e08b89-b23e-4fca-a6d5-eba471139389" released by "_copy_volume_from_snapshot" :: held 6.706s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:53 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Lock "cinder-quobyte-ec589857-dded-4f12-a14c-c64cba5f52c8-d1e08b89-b23e-4fca-a6d5-eba471139389" released by "_create_volume_from_snapshot" :: held 6.765s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.778s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f376d3b-1526-459d-8efd-788657250072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1e08b89-b23e-4fca-a6d5-eba471139389', 'volume_size': 1, 'snapshot_id': 'ec589857-dded-4f12-a14c-c64cba5f52c8'}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c05fd49-5bde-401f-bf3b-172754cd9b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:53 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Volume volume-d1e08b89-b23e-4fca-a6d5-eba471139389 (d1e08b89-b23e-4fca-a6d5-eba471139389): created successfully Nov 04 19:05:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c05fd49-5bde-401f-bf3b-172754cd9b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Flow 'volume_create_manager' (98a012a9-36c8-465b-99cf-b89c58b6c2ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:53 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-cf1ccbd9-0f8b-4f64-a31d-ddbad2776791 tempest-VolumeDependencyTests-1265681919 None] Created volume successfully. Nov 04 19:05:54 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a1843245-e6c2-486a-bf9a-39580bc91679 tempest-VolumeDependencyTests-1265681919 None] Acquiring lock "cinder-ec589857-dded-4f12-a14c-c64cba5f52c8-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:54 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a1843245-e6c2-486a-bf9a-39580bc91679 tempest-VolumeDependencyTests-1265681919 None] Lock "cinder-ec589857-dded-4f12-a14c-c64cba5f52c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:54 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a1843245-e6c2-486a-bf9a-39580bc91679 tempest-VolumeDependencyTests-1265681919 None] Acquiring lock "cinder-quobyte-5f619600-f40f-49a3-9494-6d2d515abd91" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:54 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a1843245-e6c2-486a-bf9a-39580bc91679 tempest-VolumeDependencyTests-1265681919 None] Lock "cinder-quobyte-5f619600-f40f-49a3-9494-6d2d515abd91" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:54 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a1843245-e6c2-486a-bf9a-39580bc91679 tempest-VolumeDependencyTests-1265681919 None] Acquiring lock "cinder-quobyte-ec589857-dded-4f12-a14c-c64cba5f52c8" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:54 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a1843245-e6c2-486a-bf9a-39580bc91679 tempest-VolumeDependencyTests-1265681919 None] Lock "cinder-quobyte-ec589857-dded-4f12-a14c-c64cba5f52c8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:54 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-a1843245-e6c2-486a-bf9a-39580bc91679 tempest-VolumeDependencyTests-1265681919 None] Deleting offline snapshot ec589857-dded-4f12-a14c-c64cba5f52c8 of volume 5f619600-f40f-49a3-9494-6d2d515abd91 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:05:54 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-a1843245-e6c2-486a-bf9a-39580bc91679 tempest-VolumeDependencyTests-1265681919 None] snapshot_file for this snap is: volume-5f619600-f40f-49a3-9494-6d2d515abd91.ec589857-dded-4f12-a14c-c64cba5f52c8 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:05:54 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca549e0d-5429-45e9-9247-f61e89c6ed72]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a1843245-e6c2-486a-bf9a-39580bc91679 tempest-VolumeDependencyTests-1265681919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.ec589857-dded-4f12-a14c-c64cba5f52c8 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:54 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.ec589857-dded-4f12-a14c-c64cba5f52c8 Nov 04 19:05:54 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:54 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a1843245-e6c2-486a-bf9a-39580bc91679 tempest-VolumeDependencyTests-1265681919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.ec589857-dded-4f12-a14c-c64cba5f52c8" returned: 0 in 0.340s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:54 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-a1843245-e6c2-486a-bf9a-39580bc91679 tempest-VolumeDependencyTests-1265681919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f619600-f40f-49a3-9494-6d2d515abd91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:05:54 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd24bdb-7835-4b51-984c-8345e7d1d99c]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a1843245-e6c2-486a-bf9a-39580bc91679 tempest-VolumeDependencyTests-1265681919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:55 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91 Nov 04 19:05:55 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:55 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a1843245-e6c2-486a-bf9a-39580bc91679 tempest-VolumeDependencyTests-1265681919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91" returned: 0 in 0.522s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a1843245-e6c2-486a-bf9a-39580bc91679 tempest-VolumeDependencyTests-1265681919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.ec589857-dded-4f12-a14c-c64cba5f52c8 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:55 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.ec589857-dded-4f12-a14c-c64cba5f52c8 Nov 04 19:05:55 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:55 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a1843245-e6c2-486a-bf9a-39580bc91679 tempest-VolumeDependencyTests-1265681919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.ec589857-dded-4f12-a14c-c64cba5f52c8" returned: 0 in 0.305s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a1843245-e6c2-486a-bf9a-39580bc91679 tempest-VolumeDependencyTests-1265681919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.ec589857-dded-4f12-a14c-c64cba5f52c8 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:55 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.ec589857-dded-4f12-a14c-c64cba5f52c8 Nov 04 19:05:55 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:55 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a1843245-e6c2-486a-bf9a-39580bc91679 tempest-VolumeDependencyTests-1265681919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91.ec589857-dded-4f12-a14c-c64cba5f52c8" returned: 0 in 0.230s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:56 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a1843245-e6c2-486a-bf9a-39580bc91679 tempest-VolumeDependencyTests-1265681919 None] Lock "cinder-quobyte-ec589857-dded-4f12-a14c-c64cba5f52c8" released by "_delete_snapshot" :: held 1.494s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:56 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a1843245-e6c2-486a-bf9a-39580bc91679 tempest-VolumeDependencyTests-1265681919 None] Lock "cinder-quobyte-5f619600-f40f-49a3-9494-6d2d515abd91" released by "delete_snapshot" :: held 1.515s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:56 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-a1843245-e6c2-486a-bf9a-39580bc91679 tempest-VolumeDependencyTests-1265681919 None] Created reservations ['532bb4e9-b014-4954-b610-26be5db68cce', '741391cc-52e6-4599-9818-505c9d1f5411', 'aa251a16-1965-43c7-b59c-ff9c0cfef050', 'f6ddfd38-6f7f-44ed-a846-475ded5f6ab1'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:05:56 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-a1843245-e6c2-486a-bf9a-39580bc91679 tempest-VolumeDependencyTests-1265681919 None] Delete snapshot completed successfully. Nov 04 19:05:56 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a1843245-e6c2-486a-bf9a-39580bc91679 tempest-VolumeDependencyTests-1265681919 None] Lock "cinder-ec589857-dded-4f12-a14c-c64cba5f52c8-delete_snapshot" released by "delete_snapshot" :: held 1.641s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:56 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-15af2e5c-6e34-451f-bf76-2c183347d6d8 tempest-VolumeDependencyTests-1265681919 None] Acquiring lock "cinder-5f619600-f40f-49a3-9494-6d2d515abd91-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:56 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-15af2e5c-6e34-451f-bf76-2c183347d6d8 tempest-VolumeDependencyTests-1265681919 None] Lock "cinder-5f619600-f40f-49a3-9494-6d2d515abd91-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:56 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-15af2e5c-6e34-451f-bf76-2c183347d6d8 tempest-VolumeDependencyTests-1265681919 None] Acquiring lock "cinder-quobyte-5f619600-f40f-49a3-9494-6d2d515abd91" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:56 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-15af2e5c-6e34-451f-bf76-2c183347d6d8 tempest-VolumeDependencyTests-1265681919 None] Lock "cinder-quobyte-5f619600-f40f-49a3-9494-6d2d515abd91" acquired by "delete_volume" :: waited 0.014s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:56 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ade3b8-b293-4abd-8b58-a58bbd0a1617]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-15af2e5c-6e34-451f-bf76-2c183347d6d8 tempest-VolumeDependencyTests-1265681919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:56 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91 Nov 04 19:05:56 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:57 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-15af2e5c-6e34-451f-bf76-2c183347d6d8 tempest-VolumeDependencyTests-1265681919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91" returned: 0 in 0.378s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-15af2e5c-6e34-451f-bf76-2c183347d6d8 tempest-VolumeDependencyTests-1265681919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:57 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91 Nov 04 19:05:57 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:57 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-15af2e5c-6e34-451f-bf76-2c183347d6d8 tempest-VolumeDependencyTests-1265681919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-5f619600-f40f-49a3-9494-6d2d515abd91" returned: 0 in 0.235s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:57 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-15af2e5c-6e34-451f-bf76-2c183347d6d8 tempest-VolumeDependencyTests-1265681919 None] Lock "cinder-quobyte-5f619600-f40f-49a3-9494-6d2d515abd91" released by "delete_volume" :: held 0.680s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:57 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-15af2e5c-6e34-451f-bf76-2c183347d6d8 tempest-VolumeDependencyTests-1265681919 None] Created reservations ['a9b831fe-016d-4c06-a971-6d73ce2d5611', 'de0dc8d5-a93d-454c-9dd2-196eafa42a6d', 'd60a59c8-d493-41fe-9631-7e93a132b9a6', 'b2323019-b37b-49d1-bfcd-b1875be726f7'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:05:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-15af2e5c-6e34-451f-bf76-2c183347d6d8 tempest-VolumeDependencyTests-1265681919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-15af2e5c-6e34-451f-bf76-2c183347d6d8 tempest-VolumeDependencyTests-1265681919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-15af2e5c-6e34-451f-bf76-2c183347d6d8 tempest-VolumeDependencyTests-1265681919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-15af2e5c-6e34-451f-bf76-2c183347d6d8 tempest-VolumeDependencyTests-1265681919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-15af2e5c-6e34-451f-bf76-2c183347d6d8 tempest-VolumeDependencyTests-1265681919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-15af2e5c-6e34-451f-bf76-2c183347d6d8 tempest-VolumeDependencyTests-1265681919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:57 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:05:57 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:57 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-15af2e5c-6e34-451f-bf76-2c183347d6d8 tempest-VolumeDependencyTests-1265681919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.247s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:57 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-15af2e5c-6e34-451f-bf76-2c183347d6d8 tempest-VolumeDependencyTests-1265681919 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:05:57 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-15af2e5c-6e34-451f-bf76-2c183347d6d8 tempest-VolumeDependencyTests-1265681919 None] Deleted volume successfully. Nov 04 19:05:57 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-15af2e5c-6e34-451f-bf76-2c183347d6d8 tempest-VolumeDependencyTests-1265681919 None] Lock "cinder-5f619600-f40f-49a3-9494-6d2d515abd91-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:57 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e17aaff7-6d1e-44dc-9374-22238aa5a378 tempest-VolumeDependencyTests-1265681919 None] Acquiring lock "cinder-d1e08b89-b23e-4fca-a6d5-eba471139389-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:57 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e17aaff7-6d1e-44dc-9374-22238aa5a378 tempest-VolumeDependencyTests-1265681919 None] Lock "cinder-d1e08b89-b23e-4fca-a6d5-eba471139389-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:57 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e17aaff7-6d1e-44dc-9374-22238aa5a378 tempest-VolumeDependencyTests-1265681919 None] Acquiring lock "cinder-quobyte-d1e08b89-b23e-4fca-a6d5-eba471139389" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:57 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e17aaff7-6d1e-44dc-9374-22238aa5a378 tempest-VolumeDependencyTests-1265681919 None] Lock "cinder-quobyte-d1e08b89-b23e-4fca-a6d5-eba471139389" acquired by "delete_volume" :: waited 0.015s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:57 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bd8fcb-0070-49be-a683-8924817b5e8c]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e17aaff7-6d1e-44dc-9374-22238aa5a378 tempest-VolumeDependencyTests-1265681919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d1e08b89-b23e-4fca-a6d5-eba471139389 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:57 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d1e08b89-b23e-4fca-a6d5-eba471139389 Nov 04 19:05:57 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:58 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e17aaff7-6d1e-44dc-9374-22238aa5a378 tempest-VolumeDependencyTests-1265681919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d1e08b89-b23e-4fca-a6d5-eba471139389" returned: 0 in 0.336s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e17aaff7-6d1e-44dc-9374-22238aa5a378 tempest-VolumeDependencyTests-1265681919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d1e08b89-b23e-4fca-a6d5-eba471139389 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:58 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d1e08b89-b23e-4fca-a6d5-eba471139389 Nov 04 19:05:58 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:58 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e17aaff7-6d1e-44dc-9374-22238aa5a378 tempest-VolumeDependencyTests-1265681919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d1e08b89-b23e-4fca-a6d5-eba471139389" returned: 0 in 0.231s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:58 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e17aaff7-6d1e-44dc-9374-22238aa5a378 tempest-VolumeDependencyTests-1265681919 None] Lock "cinder-quobyte-d1e08b89-b23e-4fca-a6d5-eba471139389" released by "delete_volume" :: held 0.611s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:58 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-e17aaff7-6d1e-44dc-9374-22238aa5a378 tempest-VolumeDependencyTests-1265681919 None] Created reservations ['e540ec86-8028-4ee7-b16c-1428b2c73562', '30360166-605a-4cea-94ff-e6c3d3154a3b', '67d4ba76-d8e6-4b6e-9e4e-d1f49885c86d', '4c64ff86-1e7f-47e1-a095-2e8429b199f0'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:05:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e17aaff7-6d1e-44dc-9374-22238aa5a378 tempest-VolumeDependencyTests-1265681919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e17aaff7-6d1e-44dc-9374-22238aa5a378 tempest-VolumeDependencyTests-1265681919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:58 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e17aaff7-6d1e-44dc-9374-22238aa5a378 tempest-VolumeDependencyTests-1265681919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:58 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e17aaff7-6d1e-44dc-9374-22238aa5a378 tempest-VolumeDependencyTests-1265681919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e17aaff7-6d1e-44dc-9374-22238aa5a378 tempest-VolumeDependencyTests-1265681919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e17aaff7-6d1e-44dc-9374-22238aa5a378 tempest-VolumeDependencyTests-1265681919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:58 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:05:58 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:58 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e17aaff7-6d1e-44dc-9374-22238aa5a378 tempest-VolumeDependencyTests-1265681919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.229s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:58 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-e17aaff7-6d1e-44dc-9374-22238aa5a378 tempest-VolumeDependencyTests-1265681919 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:05:58 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e17aaff7-6d1e-44dc-9374-22238aa5a378 tempest-VolumeDependencyTests-1265681919 None] Deleted volume successfully. Nov 04 19:05:58 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e17aaff7-6d1e-44dc-9374-22238aa5a378 tempest-VolumeDependencyTests-1265681919 None] Lock "cinder-d1e08b89-b23e-4fca-a6d5-eba471139389-delete_volume" released by "delete_volume" :: held 1.023s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Flow 'volume_create_manager' (b7b340e8-e557-43cc-baca-93eaec827f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5827a43c-aead-40cb-8d32-eac0f9e71c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5827a43c-aead-40cb-8d32-eac0f9e71c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1933388310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2a5b48-f551-4998-8e09-931933cef59a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ffcd587c6ed4b33b0d990f547c15d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:02Z,use_quota=True,user_id='0f4024d2ef0641769f4a447c3960a907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c33dc3a3-bc0d-4599-a20e-882f7186cfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c33dc3a3-bc0d-4599-a20e-882f7186cfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c5b72c-deac-46b1-a3ef-cdfd48d13661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c5b72c-deac-46b1-a3ef-cdfd48d13661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d2a5b48-f551-4998-8e09-931933cef59a', 'volume_name': 'volume-9d2a5b48-f551-4998-8e09-931933cef59a', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b253cfba-b100-4061-a443-4ff1a055481c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b253cfba-b100-4061-a443-4ff1a055481c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6aa606c-74de-422c-b40b-f431b85abf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:02 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Volume 9d2a5b48-f551-4998-8e09-931933cef59a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d2a5b48-f551-4998-8e09-931933cef59a', 'volume_size': 1} Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1933388310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2a5b48-f551-4998-8e09-931933cef59a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ffcd587c6ed4b33b0d990f547c15d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:02Z,use_quota=True,user_id='0f4024d2ef0641769f4a447c3960a907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Creating volume 9d2a5b48-f551-4998-8e09-931933cef59a {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:02 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-9d2a5b48-f551-4998-8e09-931933cef59a 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:02 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-9d2a5b48-f551-4998-8e09-931933cef59a 1073741824 Nov 04 19:06:02 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:02 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-9d2a5b48-f551-4998-8e09-931933cef59a 1073741824" returned: 0 in 0.386s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-9d2a5b48-f551-4998-8e09-931933cef59a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:02 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-9d2a5b48-f551-4998-8e09-931933cef59a Nov 04 19:06:02 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:02 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-9d2a5b48-f551-4998-8e09-931933cef59a" returned: 0 in 0.233s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] <== create_volume: return (657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.660s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6aa606c-74de-422c-b40b-f431b85abf83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d2a5b48-f551-4998-8e09-931933cef59a', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b38163b-076e-482e-a92b-b7aeb78f8783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:02 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Volume volume-9d2a5b48-f551-4998-8e09-931933cef59a (9d2a5b48-f551-4998-8e09-931933cef59a): created successfully Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b38163b-076e-482e-a92b-b7aeb78f8783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Flow 'volume_create_manager' (b7b340e8-e557-43cc-baca-93eaec827f9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:02 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-05c9ac33-e32c-47ab-849c-840978e5d63b tempest-ProjectReaderTests-1465160132 None] Created volume successfully. Nov 04 19:06:03 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6eb540c2-be1a-483c-b268-46a523a4ffe3 tempest-ProjectReaderTests-1465160132 None] Acquiring lock "cinder-9d2a5b48-f551-4998-8e09-931933cef59a-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:03 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6eb540c2-be1a-483c-b268-46a523a4ffe3 tempest-ProjectReaderTests-1465160132 None] Lock "cinder-9d2a5b48-f551-4998-8e09-931933cef59a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:03 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6eb540c2-be1a-483c-b268-46a523a4ffe3 tempest-ProjectReaderTests-1465160132 None] Acquiring lock "cinder-quobyte-9d2a5b48-f551-4998-8e09-931933cef59a" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:03 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6eb540c2-be1a-483c-b268-46a523a4ffe3 tempest-ProjectReaderTests-1465160132 None] Lock "cinder-quobyte-9d2a5b48-f551-4998-8e09-931933cef59a" acquired by "delete_volume" :: waited 0.014s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:03 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd158c8-8cfa-4744-b2e4-d34c950dd375]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6eb540c2-be1a-483c-b268-46a523a4ffe3 tempest-ProjectReaderTests-1465160132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-9d2a5b48-f551-4998-8e09-931933cef59a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:03 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-9d2a5b48-f551-4998-8e09-931933cef59a Nov 04 19:06:03 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:03 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6eb540c2-be1a-483c-b268-46a523a4ffe3 tempest-ProjectReaderTests-1465160132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-9d2a5b48-f551-4998-8e09-931933cef59a" returned: 0 in 0.354s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6eb540c2-be1a-483c-b268-46a523a4ffe3 tempest-ProjectReaderTests-1465160132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-9d2a5b48-f551-4998-8e09-931933cef59a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:03 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-9d2a5b48-f551-4998-8e09-931933cef59a Nov 04 19:06:03 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:04 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6eb540c2-be1a-483c-b268-46a523a4ffe3 tempest-ProjectReaderTests-1465160132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-9d2a5b48-f551-4998-8e09-931933cef59a" returned: 0 in 0.240s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6eb540c2-be1a-483c-b268-46a523a4ffe3 tempest-ProjectReaderTests-1465160132 None] Lock "cinder-quobyte-9d2a5b48-f551-4998-8e09-931933cef59a" released by "delete_volume" :: held 0.638s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:04 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-6eb540c2-be1a-483c-b268-46a523a4ffe3 tempest-ProjectReaderTests-1465160132 None] Created reservations ['b7b232ea-5ad4-44e5-b505-f20f99475022', '322c1a7c-6041-4ff2-b876-96a7c14474c7', 'd5148a19-5481-4f5f-8200-674f39637262', '0dca030b-1dd3-4f70-880a-0f90a7c39293'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6eb540c2-be1a-483c-b268-46a523a4ffe3 tempest-ProjectReaderTests-1465160132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6eb540c2-be1a-483c-b268-46a523a4ffe3 tempest-ProjectReaderTests-1465160132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:04 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-6eb540c2-be1a-483c-b268-46a523a4ffe3 tempest-ProjectReaderTests-1465160132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:04 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-6eb540c2-be1a-483c-b268-46a523a4ffe3 tempest-ProjectReaderTests-1465160132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6eb540c2-be1a-483c-b268-46a523a4ffe3 tempest-ProjectReaderTests-1465160132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6eb540c2-be1a-483c-b268-46a523a4ffe3 tempest-ProjectReaderTests-1465160132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:04 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:06:04 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:04 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6eb540c2-be1a-483c-b268-46a523a4ffe3 tempest-ProjectReaderTests-1465160132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.239s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:04 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-6eb540c2-be1a-483c-b268-46a523a4ffe3 tempest-ProjectReaderTests-1465160132 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:04 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-6eb540c2-be1a-483c-b268-46a523a4ffe3 tempest-ProjectReaderTests-1465160132 None] Deleted volume successfully. Nov 04 19:06:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6eb540c2-be1a-483c-b268-46a523a4ffe3 tempest-ProjectReaderTests-1465160132 None] Lock "cinder-9d2a5b48-f551-4998-8e09-931933cef59a-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:04 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Flow 'volume_create_manager' (120cca2f-84e3-472c-9185-544e2cc4a08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c75eaf0d-e0d3-47b4-9f87-71993fc35d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c75eaf0d-e0d3-47b4-9f87-71993fc35d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-776159120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94050f81-b0cf-42f8-959d-49cbf4d5a9e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ffcd587c6ed4b33b0d990f547c15d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:05Z,use_quota=True,user_id='0f4024d2ef0641769f4a447c3960a907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8b3112-87b0-416f-b767-bf1c8007c988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8b3112-87b0-416f-b767-bf1c8007c988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31fdb0b-1baa-48b0-a636-c6da4fd7c9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31fdb0b-1baa-48b0-a636-c6da4fd7c9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94050f81-b0cf-42f8-959d-49cbf4d5a9e0', 'volume_name': 'volume-94050f81-b0cf-42f8-959d-49cbf4d5a9e0', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9cf6f88-6114-4e56-b47c-88c4e1cc9a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9cf6f88-6114-4e56-b47c-88c4e1cc9a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e6ea34-7c9b-40a4-bf39-84adef39de06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:05 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Volume 94050f81-b0cf-42f8-959d-49cbf4d5a9e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94050f81-b0cf-42f8-959d-49cbf4d5a9e0', 'volume_size': 1} Nov 04 19:06:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-776159120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94050f81-b0cf-42f8-959d-49cbf4d5a9e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ffcd587c6ed4b33b0d990f547c15d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:05Z,use_quota=True,user_id='0f4024d2ef0641769f4a447c3960a907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Creating volume 94050f81-b0cf-42f8-959d-49cbf4d5a9e0 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:05 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:06:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-94050f81-b0cf-42f8-959d-49cbf4d5a9e0 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:05 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-94050f81-b0cf-42f8-959d-49cbf4d5a9e0 1073741824 Nov 04 19:06:05 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:05 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-94050f81-b0cf-42f8-959d-49cbf4d5a9e0 1073741824" returned: 0 in 0.405s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-94050f81-b0cf-42f8-959d-49cbf4d5a9e0 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:05 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-94050f81-b0cf-42f8-959d-49cbf4d5a9e0 Nov 04 19:06:05 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:05 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-94050f81-b0cf-42f8-959d-49cbf4d5a9e0" returned: 0 in 0.235s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e6ea34-7c9b-40a4-bf39-84adef39de06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94050f81-b0cf-42f8-959d-49cbf4d5a9e0', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a8e65b-b4a5-4b4c-a56c-59965c963a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:05 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Volume volume-94050f81-b0cf-42f8-959d-49cbf4d5a9e0 (94050f81-b0cf-42f8-959d-49cbf4d5a9e0): created successfully Nov 04 19:06:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a8e65b-b4a5-4b4c-a56c-59965c963a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Flow 'volume_create_manager' (120cca2f-84e3-472c-9185-544e2cc4a08d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:05 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-2ddadf75-e4c5-4550-b158-9bffd1c6ac43 tempest-ProjectReaderTests-1465160132 None] Created volume successfully. Nov 04 19:06:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a994db28-13e7-4a03-b14d-8097ff23a221 tempest-ProjectReaderTests-1465160132 None] Acquiring lock "cinder-94050f81-b0cf-42f8-959d-49cbf4d5a9e0-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a994db28-13e7-4a03-b14d-8097ff23a221 tempest-ProjectReaderTests-1465160132 None] Lock "cinder-94050f81-b0cf-42f8-959d-49cbf4d5a9e0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a994db28-13e7-4a03-b14d-8097ff23a221 tempest-ProjectReaderTests-1465160132 None] Acquiring lock "cinder-quobyte-94050f81-b0cf-42f8-959d-49cbf4d5a9e0" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a994db28-13e7-4a03-b14d-8097ff23a221 tempest-ProjectReaderTests-1465160132 None] Lock "cinder-quobyte-94050f81-b0cf-42f8-959d-49cbf4d5a9e0" acquired by "delete_volume" :: waited 0.018s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:06 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ed176f-f9ff-4f2d-8055-1ef8287a27d3]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a994db28-13e7-4a03-b14d-8097ff23a221 tempest-ProjectReaderTests-1465160132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-94050f81-b0cf-42f8-959d-49cbf4d5a9e0 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:06 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-94050f81-b0cf-42f8-959d-49cbf4d5a9e0 Nov 04 19:06:06 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:06 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a994db28-13e7-4a03-b14d-8097ff23a221 tempest-ProjectReaderTests-1465160132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-94050f81-b0cf-42f8-959d-49cbf4d5a9e0" returned: 0 in 0.378s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a994db28-13e7-4a03-b14d-8097ff23a221 tempest-ProjectReaderTests-1465160132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-94050f81-b0cf-42f8-959d-49cbf4d5a9e0 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:06 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-94050f81-b0cf-42f8-959d-49cbf4d5a9e0 Nov 04 19:06:06 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:06 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a994db28-13e7-4a03-b14d-8097ff23a221 tempest-ProjectReaderTests-1465160132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-94050f81-b0cf-42f8-959d-49cbf4d5a9e0" returned: 0 in 0.246s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a994db28-13e7-4a03-b14d-8097ff23a221 tempest-ProjectReaderTests-1465160132 None] Lock "cinder-quobyte-94050f81-b0cf-42f8-959d-49cbf4d5a9e0" released by "delete_volume" :: held 0.667s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:06 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-a994db28-13e7-4a03-b14d-8097ff23a221 tempest-ProjectReaderTests-1465160132 None] Created reservations ['442ad3eb-f596-4bf4-9572-dee1d81754fd', 'b8b1783d-a21c-4e17-bde8-c6fadb3ba0cd', 'a513626e-4840-4270-b9ed-1ee2e1f4e915', '1eb06c14-f4d4-4ab9-9374-b29f5ddc6e90'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a994db28-13e7-4a03-b14d-8097ff23a221 tempest-ProjectReaderTests-1465160132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a994db28-13e7-4a03-b14d-8097ff23a221 tempest-ProjectReaderTests-1465160132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:06 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a994db28-13e7-4a03-b14d-8097ff23a221 tempest-ProjectReaderTests-1465160132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:06 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a994db28-13e7-4a03-b14d-8097ff23a221 tempest-ProjectReaderTests-1465160132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a994db28-13e7-4a03-b14d-8097ff23a221 tempest-ProjectReaderTests-1465160132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a994db28-13e7-4a03-b14d-8097ff23a221 tempest-ProjectReaderTests-1465160132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:06 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:06:06 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:07 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a994db28-13e7-4a03-b14d-8097ff23a221 tempest-ProjectReaderTests-1465160132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.235s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:07 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-a994db28-13e7-4a03-b14d-8097ff23a221 tempest-ProjectReaderTests-1465160132 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:07 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-a994db28-13e7-4a03-b14d-8097ff23a221 tempest-ProjectReaderTests-1465160132 None] Deleted volume successfully. Nov 04 19:06:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a994db28-13e7-4a03-b14d-8097ff23a221 tempest-ProjectReaderTests-1465160132 None] Lock "cinder-94050f81-b0cf-42f8-959d-49cbf4d5a9e0-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:07 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Flow 'volume_create_manager' (b20a4af2-a50f-4685-9805-e92e1fa19433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1df8579-a426-47b4-95c8-f4588a6bf0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1df8579-a426-47b4-95c8-f4588a6bf0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1733074895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3db64c74-29c2-4969-8796-4d381a0c955d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ffcd587c6ed4b33b0d990f547c15d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:08Z,use_quota=True,user_id='0f4024d2ef0641769f4a447c3960a907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (424500bb-525f-43e5-a893-21df2436790d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (424500bb-525f-43e5-a893-21df2436790d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df595a5-2459-4a25-a1fa-1eef5692fd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df595a5-2459-4a25-a1fa-1eef5692fd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3db64c74-29c2-4969-8796-4d381a0c955d', 'volume_name': 'volume-3db64c74-29c2-4969-8796-4d381a0c955d', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40794126-40a9-4c82-9148-e464c0ebf625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40794126-40a9-4c82-9148-e464c0ebf625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc10832b-1f10-4136-af40-b7590bb40b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:07 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Volume 3db64c74-29c2-4969-8796-4d381a0c955d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3db64c74-29c2-4969-8796-4d381a0c955d', 'volume_size': 1} Nov 04 19:06:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1733074895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3db64c74-29c2-4969-8796-4d381a0c955d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ffcd587c6ed4b33b0d990f547c15d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:08Z,use_quota=True,user_id='0f4024d2ef0641769f4a447c3960a907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Creating volume 3db64c74-29c2-4969-8796-4d381a0c955d {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:07 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:06:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3db64c74-29c2-4969-8796-4d381a0c955d 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:07 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3db64c74-29c2-4969-8796-4d381a0c955d 1073741824 Nov 04 19:06:07 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:08 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3db64c74-29c2-4969-8796-4d381a0c955d 1073741824" returned: 0 in 0.387s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3db64c74-29c2-4969-8796-4d381a0c955d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:08 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3db64c74-29c2-4969-8796-4d381a0c955d Nov 04 19:06:08 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:08 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3db64c74-29c2-4969-8796-4d381a0c955d" returned: 0 in 0.226s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] <== create_volume: return (653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.656s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:08 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:UPDATE=108,cinder:SELECT=91,cinder:INSERT=31,cinder:DELETE=8 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:06:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc10832b-1f10-4136-af40-b7590bb40b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3db64c74-29c2-4969-8796-4d381a0c955d', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51c28832-5661-4c95-8b30-a37cd07ae71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:08 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Volume volume-3db64c74-29c2-4969-8796-4d381a0c955d (3db64c74-29c2-4969-8796-4d381a0c955d): created successfully Nov 04 19:06:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51c28832-5661-4c95-8b30-a37cd07ae71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Flow 'volume_create_manager' (b20a4af2-a50f-4685-9805-e92e1fa19433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:08 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-de06fc14-c769-4386-a84c-877b01834efc tempest-ProjectReaderTests-1465160132 None] Created volume successfully. Nov 04 19:06:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0e765b6b-4bf1-4649-bfe7-853d86fe3e58 tempest-ProjectReaderTests-1465160132 None] Acquiring lock "cinder-3db64c74-29c2-4969-8796-4d381a0c955d-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0e765b6b-4bf1-4649-bfe7-853d86fe3e58 tempest-ProjectReaderTests-1465160132 None] Lock "cinder-3db64c74-29c2-4969-8796-4d381a0c955d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0e765b6b-4bf1-4649-bfe7-853d86fe3e58 tempest-ProjectReaderTests-1465160132 None] Acquiring lock "cinder-quobyte-3db64c74-29c2-4969-8796-4d381a0c955d" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0e765b6b-4bf1-4649-bfe7-853d86fe3e58 tempest-ProjectReaderTests-1465160132 None] Lock "cinder-quobyte-3db64c74-29c2-4969-8796-4d381a0c955d" acquired by "delete_volume" :: waited 0.015s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:08 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61a888f-ff12-4d3f-892d-cf0b19ee7ac1]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0e765b6b-4bf1-4649-bfe7-853d86fe3e58 tempest-ProjectReaderTests-1465160132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3db64c74-29c2-4969-8796-4d381a0c955d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:08 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3db64c74-29c2-4969-8796-4d381a0c955d Nov 04 19:06:08 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:09 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0e765b6b-4bf1-4649-bfe7-853d86fe3e58 tempest-ProjectReaderTests-1465160132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3db64c74-29c2-4969-8796-4d381a0c955d" returned: 0 in 0.339s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0e765b6b-4bf1-4649-bfe7-853d86fe3e58 tempest-ProjectReaderTests-1465160132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3db64c74-29c2-4969-8796-4d381a0c955d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:09 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3db64c74-29c2-4969-8796-4d381a0c955d Nov 04 19:06:09 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:09 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0e765b6b-4bf1-4649-bfe7-853d86fe3e58 tempest-ProjectReaderTests-1465160132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3db64c74-29c2-4969-8796-4d381a0c955d" returned: 0 in 0.239s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0e765b6b-4bf1-4649-bfe7-853d86fe3e58 tempest-ProjectReaderTests-1465160132 None] Lock "cinder-quobyte-3db64c74-29c2-4969-8796-4d381a0c955d" released by "delete_volume" :: held 0.619s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:09 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-0e765b6b-4bf1-4649-bfe7-853d86fe3e58 tempest-ProjectReaderTests-1465160132 None] Created reservations ['e933e5ab-e47c-425a-9f9f-7f459f4733f0', 'a6d1c12c-8c82-46c4-96a2-d15339e8b534', '2d9bfe5f-c93c-4465-96be-d36b729a2d69', '94259f1f-b90e-4086-9835-4014fe45387f'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0e765b6b-4bf1-4649-bfe7-853d86fe3e58 tempest-ProjectReaderTests-1465160132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0e765b6b-4bf1-4649-bfe7-853d86fe3e58 tempest-ProjectReaderTests-1465160132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0e765b6b-4bf1-4649-bfe7-853d86fe3e58 tempest-ProjectReaderTests-1465160132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0e765b6b-4bf1-4649-bfe7-853d86fe3e58 tempest-ProjectReaderTests-1465160132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0e765b6b-4bf1-4649-bfe7-853d86fe3e58 tempest-ProjectReaderTests-1465160132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0e765b6b-4bf1-4649-bfe7-853d86fe3e58 tempest-ProjectReaderTests-1465160132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:09 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:06:09 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:09 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0e765b6b-4bf1-4649-bfe7-853d86fe3e58 tempest-ProjectReaderTests-1465160132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.241s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:09 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-0e765b6b-4bf1-4649-bfe7-853d86fe3e58 tempest-ProjectReaderTests-1465160132 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:09 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-0e765b6b-4bf1-4649-bfe7-853d86fe3e58 tempest-ProjectReaderTests-1465160132 None] Deleted volume successfully. Nov 04 19:06:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0e765b6b-4bf1-4649-bfe7-853d86fe3e58 tempest-ProjectReaderTests-1465160132 None] Lock "cinder-3db64c74-29c2-4969-8796-4d381a0c955d-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Flow 'volume_create_manager' (00e36514-6479-454a-9f53-d09b6fa3aa90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f6dce89-f1ef-40c7-ac1a-e85d8a023968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f6dce89-f1ef-40c7-ac1a-e85d8a023968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-537158100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e782e8-dc20-4891-a420-464d2f7c7222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ffcd587c6ed4b33b0d990f547c15d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:10Z,use_quota=True,user_id='0f4024d2ef0641769f4a447c3960a907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d028fe-e2ba-408d-9cea-28c09b81fa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d028fe-e2ba-408d-9cea-28c09b81fa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7901591-b1a1-42bb-9709-49b9068a1694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7901591-b1a1-42bb-9709-49b9068a1694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9e782e8-dc20-4891-a420-464d2f7c7222', 'volume_name': 'volume-b9e782e8-dc20-4891-a420-464d2f7c7222', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad373cb-e8e4-431e-8298-bca52807eeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad373cb-e8e4-431e-8298-bca52807eeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e349c2-09ba-47d6-a000-7aade2e693c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:10 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Volume b9e782e8-dc20-4891-a420-464d2f7c7222: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9e782e8-dc20-4891-a420-464d2f7c7222', 'volume_size': 1} Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-537158100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e782e8-dc20-4891-a420-464d2f7c7222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ffcd587c6ed4b33b0d990f547c15d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:10Z,use_quota=True,user_id='0f4024d2ef0641769f4a447c3960a907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Creating volume b9e782e8-dc20-4891-a420-464d2f7c7222 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:10 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9e782e8-dc20-4891-a420-464d2f7c7222 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:10 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9e782e8-dc20-4891-a420-464d2f7c7222 1073741824 Nov 04 19:06:10 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:10 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9e782e8-dc20-4891-a420-464d2f7c7222 1073741824" returned: 0 in 0.415s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9e782e8-dc20-4891-a420-464d2f7c7222 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:10 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9e782e8-dc20-4891-a420-464d2f7c7222 Nov 04 19:06:10 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:10 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9e782e8-dc20-4891-a420-464d2f7c7222" returned: 0 in 0.228s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e349c2-09ba-47d6-a000-7aade2e693c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9e782e8-dc20-4891-a420-464d2f7c7222', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53fe5b0-976a-4028-ad22-f42de547e791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:10 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Volume volume-b9e782e8-dc20-4891-a420-464d2f7c7222 (b9e782e8-dc20-4891-a420-464d2f7c7222): created successfully Nov 04 19:06:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53fe5b0-976a-4028-ad22-f42de547e791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Flow 'volume_create_manager' (00e36514-6479-454a-9f53-d09b6fa3aa90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:11 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-665d88e8-cf82-485d-adc0-debca93c8cc1 tempest-ProjectReaderTests-1465160132 None] Created volume successfully. Nov 04 19:06:11 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-fd56bf02-f368-4f66-896e-142317d47895 tempest-ProjectReaderTests-1465160132 None] Acquiring lock "cinder-b9e782e8-dc20-4891-a420-464d2f7c7222-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:11 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-fd56bf02-f368-4f66-896e-142317d47895 tempest-ProjectReaderTests-1465160132 None] Lock "cinder-b9e782e8-dc20-4891-a420-464d2f7c7222-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:11 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-fd56bf02-f368-4f66-896e-142317d47895 tempest-ProjectReaderTests-1465160132 None] Acquiring lock "cinder-quobyte-b9e782e8-dc20-4891-a420-464d2f7c7222" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:11 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-fd56bf02-f368-4f66-896e-142317d47895 tempest-ProjectReaderTests-1465160132 None] Lock "cinder-quobyte-b9e782e8-dc20-4891-a420-464d2f7c7222" acquired by "delete_volume" :: waited 0.015s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:11 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc38315-0f49-4ca3-9d3f-66d848652a9f]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-fd56bf02-f368-4f66-896e-142317d47895 tempest-ProjectReaderTests-1465160132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9e782e8-dc20-4891-a420-464d2f7c7222 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:11 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9e782e8-dc20-4891-a420-464d2f7c7222 Nov 04 19:06:11 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:11 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-fd56bf02-f368-4f66-896e-142317d47895 tempest-ProjectReaderTests-1465160132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9e782e8-dc20-4891-a420-464d2f7c7222" returned: 0 in 0.354s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-fd56bf02-f368-4f66-896e-142317d47895 tempest-ProjectReaderTests-1465160132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9e782e8-dc20-4891-a420-464d2f7c7222 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:11 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9e782e8-dc20-4891-a420-464d2f7c7222 Nov 04 19:06:11 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:11 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-fd56bf02-f368-4f66-896e-142317d47895 tempest-ProjectReaderTests-1465160132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b9e782e8-dc20-4891-a420-464d2f7c7222" returned: 0 in 0.242s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:11 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-fd56bf02-f368-4f66-896e-142317d47895 tempest-ProjectReaderTests-1465160132 None] Lock "cinder-quobyte-b9e782e8-dc20-4891-a420-464d2f7c7222" released by "delete_volume" :: held 0.635s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:11 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=88,cinder:UPDATE=133,cinder:INSERT=38,cinder:DELETE=13 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:06:12 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-fd56bf02-f368-4f66-896e-142317d47895 tempest-ProjectReaderTests-1465160132 None] Created reservations ['27b8ade1-c849-49f5-8140-fd539948653e', '1aa779c3-7b56-47bf-8374-cbbd69ebd4d8', 'b6494012-960e-43ea-8c54-90762d4e83fc', '7db68a2b-cea5-414b-b491-dbb7e32b98a5'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-fd56bf02-f368-4f66-896e-142317d47895 tempest-ProjectReaderTests-1465160132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-fd56bf02-f368-4f66-896e-142317d47895 tempest-ProjectReaderTests-1465160132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:12 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-fd56bf02-f368-4f66-896e-142317d47895 tempest-ProjectReaderTests-1465160132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:12 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-fd56bf02-f368-4f66-896e-142317d47895 tempest-ProjectReaderTests-1465160132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-fd56bf02-f368-4f66-896e-142317d47895 tempest-ProjectReaderTests-1465160132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-fd56bf02-f368-4f66-896e-142317d47895 tempest-ProjectReaderTests-1465160132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:12 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:06:12 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:12 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-fd56bf02-f368-4f66-896e-142317d47895 tempest-ProjectReaderTests-1465160132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.271s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:12 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-fd56bf02-f368-4f66-896e-142317d47895 tempest-ProjectReaderTests-1465160132 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:12 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-fd56bf02-f368-4f66-896e-142317d47895 tempest-ProjectReaderTests-1465160132 None] Deleted volume successfully. Nov 04 19:06:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-fd56bf02-f368-4f66-896e-142317d47895 tempest-ProjectReaderTests-1465160132 None] Lock "cinder-b9e782e8-dc20-4891-a420-464d2f7c7222-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:22 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=13,cinder:INSERT=6,cinder:UPDATE=19,cinder:DELETE=1 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:06:22 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:UPDATE=6,cinder:SELECT=2,cinder:DELETE=1 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Flow 'volume_create_manager' (c1b289a9-a6c0-4129-b3f7-0c624f2075fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0ac34e-b7e4-411e-b605-f0dfe8633e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0ac34e-b7e4-411e-b605-f0dfe8633e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-806361783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b0d4d8-52b4-4323-9f45-4b8af1cee1c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa1d584a7944e3e9b506ae40a7aa4ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:25Z,use_quota=True,user_id='9ce4f38b97414d43910f30079f5ee476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b5dcd62-1d2d-47d6-b028-b305fdde14e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b5dcd62-1d2d-47d6-b028-b305fdde14e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9cc28c1-a482-4f09-97ad-527e8d0b4e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9cc28c1-a482-4f09-97ad-527e8d0b4e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12b0d4d8-52b4-4323-9f45-4b8af1cee1c7', 'volume_name': 'volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad38454-dca6-4145-8e4d-e8e68081c5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad38454-dca6-4145-8e4d-e8e68081c5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee2e685-3f6b-42ba-9418-3e00e65c8533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:25 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Volume 12b0d4d8-52b4-4323-9f45-4b8af1cee1c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7', 'volume_size': 1} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-806361783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b0d4d8-52b4-4323-9f45-4b8af1cee1c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa1d584a7944e3e9b506ae40a7aa4ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:25Z,use_quota=True,user_id='9ce4f38b97414d43910f30079f5ee476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Creating volume 12b0d4d8-52b4-4323-9f45-4b8af1cee1c7 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:25 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:25 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7 1073741824 Nov 04 19:06:25 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Flow 'volume_create_manager' (98b3302f-4118-42e9-95c6-939b5fb40671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4fa1cb-847c-4ddc-9eb6-edf9e36dba0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4fa1cb-847c-4ddc-9eb6-edf9e36dba0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-300518472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e76519d-b1c1-4833-bbed-f37e4ca1e021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d945e485696a4df7ba2f9d0452c7e446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:25Z,use_quota=True,user_id='8c446678ae7741888ecf6b6bb938b447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f502d9-7fa3-4645-9dcd-487bb1bb4a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f502d9-7fa3-4645-9dcd-487bb1bb4a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (732ca993-b94a-476c-a04e-dba580bc8d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (732ca993-b94a-476c-a04e-dba580bc8d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e76519d-b1c1-4833-bbed-f37e4ca1e021', 'volume_name': 'volume-1e76519d-b1c1-4833-bbed-f37e4ca1e021', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b502e68d-01b8-495b-b484-9a9561122ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b502e68d-01b8-495b-b484-9a9561122ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7adace5f-6286-4bd2-9030-63bbf7956f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:25 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Volume 1e76519d-b1c1-4833-bbed-f37e4ca1e021: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e76519d-b1c1-4833-bbed-f37e4ca1e021', 'volume_size': 1} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:25 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:06:25 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:25 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.289s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager._thread_info {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread count: 28 {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread info: [<_MainThread(MainThread, started 130247852032128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:06:25 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7 1073741824" returned: 0 in 0.622s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:25 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7 Nov 04 19:06:25 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Flow 'volume_create_manager' (ccbd3e77-d302-48be-be66-d5cfbf995ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c49b75-6c35-482e-a7b0-418285061172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c49b75-6c35-482e-a7b0-418285061172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1040954906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e06bd473564743b698ac5523d08c3fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:26Z,use_quota=True,user_id='6fc22b0379ef4e65ae31fdfa79981aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1737219d-1653-4311-91f6-baed0ed5fad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1737219d-1653-4311-91f6-baed0ed5fad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82008a38-1415-474b-aefb-f19fbcfbf28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82008a38-1415-474b-aefb-f19fbcfbf28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2', 'volume_name': 'volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70725a79-84ad-4b69-8be7-bc58963db521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70725a79-84ad-4b69-8be7-bc58963db521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c44870d8-dd2e-49dc-9606-df06e3a09d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:26 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Volume 11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2', 'volume_size': 1} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:26 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7" returned: 0 in 0.274s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.818s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-300518472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e76519d-b1c1-4833-bbed-f37e4ca1e021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d945e485696a4df7ba2f9d0452c7e446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:25Z,use_quota=True,user_id='8c446678ae7741888ecf6b6bb938b447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Creating volume 1e76519d-b1c1-4833-bbed-f37e4ca1e021 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:26 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1e76519d-b1c1-4833-bbed-f37e4ca1e021 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee2e685-3f6b-42ba-9418-3e00e65c8533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:26 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1e76519d-b1c1-4833-bbed-f37e4ca1e021 1073741824 Nov 04 19:06:26 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d47b43-7151-4465-82a8-bd9a24cc89d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:26 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Volume volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7 (12b0d4d8-52b4-4323-9f45-4b8af1cee1c7): created successfully Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d47b43-7151-4465-82a8-bd9a24cc89d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Flow 'volume_create_manager' (c1b289a9-a6c0-4129-b3f7-0c624f2075fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:26 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-eded4443-482d-45af-87cf-f7a16b8dfa64 tempest-VolumeDependencyTests-753308342 None] Created volume successfully. Nov 04 19:06:26 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1e76519d-b1c1-4833-bbed-f37e4ca1e021 1073741824" returned: 0 in 0.434s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1e76519d-b1c1-4833-bbed-f37e4ca1e021 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:26 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1e76519d-b1c1-4833-bbed-f37e4ca1e021 Nov 04 19:06:26 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:26 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1e76519d-b1c1-4833-bbed-f37e4ca1e021" returned: 0 in 0.281s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.800s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1040954906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e06bd473564743b698ac5523d08c3fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:26Z,use_quota=True,user_id='6fc22b0379ef4e65ae31fdfa79981aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Creating volume 11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:26 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7adace5f-6286-4bd2-9030-63bbf7956f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e76519d-b1c1-4833-bbed-f37e4ca1e021', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:26 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2 1073741824 Nov 04 19:06:26 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e93bfde-55dc-4199-8d13-4f2a180e2e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:27 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Volume volume-1e76519d-b1c1-4833-bbed-f37e4ca1e021 (1e76519d-b1c1-4833-bbed-f37e4ca1e021): created successfully Nov 04 19:06:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e93bfde-55dc-4199-8d13-4f2a180e2e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Flow 'volume_create_manager' (98b3302f-4118-42e9-95c6-939b5fb40671) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:27 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-4a02e1bf-d389-405b-b2e1-26c3bd5d1879 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Created volume successfully. Nov 04 19:06:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-81b15d9a-2fbe-455d-b3a6-ca7cfd260cbf tempest-VolumeDependencyTests-753308342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:27 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2 1073741824" returned: 0 in 0.510s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:27 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2 Nov 04 19:06:27 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:27 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2" returned: 0 in 0.260s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:27 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-81b15d9a-2fbe-455d-b3a6-ca7cfd260cbf tempest-VolumeDependencyTests-753308342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.605s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:27 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-81b15d9a-2fbe-455d-b3a6-ca7cfd260cbf tempest-VolumeDependencyTests-753308342 None] Creating offline snapshot 275e2bde-83b8-4201-9253-bb2ed2a537e1 of volume 12b0d4d8-52b4-4323-9f45-4b8af1cee1c7 {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:06:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c44870d8-dd2e-49dc-9606-df06e3a09d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf6034c-c839-4a51-940a-68c4af6eae73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:27 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8782c2-6498-4ad4-9fe7-f1cc318e986f]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-81b15d9a-2fbe-455d-b3a6-ca7cfd260cbf tempest-VolumeDependencyTests-753308342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:27 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Volume volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2 (11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2): created successfully Nov 04 19:06:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf6034c-c839-4a51-940a-68c4af6eae73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Flow 'volume_create_manager' (ccbd3e77-d302-48be-be66-d5cfbf995ff0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:27 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-494e32af-70cd-4c34-bf44-84c5fe0debfd tempest-ProjectReaderTests-421706438 None] Created volume successfully. Nov 04 19:06:27 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7 Nov 04 19:06:27 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:28 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-81b15d9a-2fbe-455d-b3a6-ca7cfd260cbf tempest-VolumeDependencyTests-753308342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7" returned: 0 in 0.421s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-81b15d9a-2fbe-455d-b3a6-ca7cfd260cbf tempest-VolumeDependencyTests-753308342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.275e2bde-83b8-4201-9253-bb2ed2a537e1 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:28 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.275e2bde-83b8-4201-9253-bb2ed2a537e1 1G Nov 04 19:06:28 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-35710291-5417-419d-89fa-d9d3bd1fcd2d tempest-ProjectReaderTests-421706438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:28 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Flow 'volume_create_manager' (8c47737e-936e-406d-bd8d-2737a786a293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb777be-c51d-41da-a4f6-434cfb37480e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb777be-c51d-41da-a4f6-434cfb37480e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-966367878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557ab331-d392-4f8f-ae9c-6062f6e664b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d945e485696a4df7ba2f9d0452c7e446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:29Z,use_quota=True,user_id='8c446678ae7741888ecf6b6bb938b447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97bb36d3-3956-450a-a73c-5910b9dfe815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97bb36d3-3956-450a-a73c-5910b9dfe815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9159076d-a108-48d3-ba3b-85c34a636c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9159076d-a108-48d3-ba3b-85c34a636c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '557ab331-d392-4f8f-ae9c-6062f6e664b7', 'volume_name': 'volume-557ab331-d392-4f8f-ae9c-6062f6e664b7', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e618884-7f85-4605-8124-9c51591b15f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e618884-7f85-4605-8124-9c51591b15f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c2b7487-29a6-4148-8f20-ff05f8daf3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:28 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Volume 557ab331-d392-4f8f-ae9c-6062f6e664b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-557ab331-d392-4f8f-ae9c-6062f6e664b7', 'volume_size': 1} Nov 04 19:06:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:28 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-81b15d9a-2fbe-455d-b3a6-ca7cfd260cbf tempest-VolumeDependencyTests-753308342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.275e2bde-83b8-4201-9253-bb2ed2a537e1 1G" returned: 0 in 0.610s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-81b15d9a-2fbe-455d-b3a6-ca7cfd260cbf tempest-VolumeDependencyTests-753308342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.275e2bde-83b8-4201-9253-bb2ed2a537e1 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:28 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.275e2bde-83b8-4201-9253-bb2ed2a537e1 Nov 04 19:06:28 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Flow 'volume_create_manager' (fe353759-a858-4a40-a88e-750930c15c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:29 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d873a2d-080a-4020-8fee-ce85579f2f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-81b15d9a-2fbe-455d-b3a6-ca7cfd260cbf tempest-VolumeDependencyTests-753308342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.275e2bde-83b8-4201-9253-bb2ed2a537e1" returned: 0 in 0.370s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:29 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-81b15d9a-2fbe-455d-b3a6-ca7cfd260cbf tempest-VolumeDependencyTests-753308342 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.275e2bde-83b8-4201-9253-bb2ed2a537e1 is being set with open permissions: ugo+rw Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-81b15d9a-2fbe-455d-b3a6-ca7cfd260cbf tempest-VolumeDependencyTests-753308342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.275e2bde-83b8-4201-9253-bb2ed2a537e1 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d873a2d-080a-4020-8fee-ce85579f2f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1574815472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dbd4865-9f33-4af0-958f-09f45304f774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d945e485696a4df7ba2f9d0452c7e446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:29Z,use_quota=True,user_id='8c446678ae7741888ecf6b6bb938b447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa9ec19-eb06-4e20-88b5-17230bcda92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:29 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.275e2bde-83b8-4201-9253-bb2ed2a537e1 Nov 04 19:06:29 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa9ec19-eb06-4e20-88b5-17230bcda92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48089aff-5a06-4a5c-a3bb-690c1d91b782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48089aff-5a06-4a5c-a3bb-690c1d91b782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dbd4865-9f33-4af0-958f-09f45304f774', 'volume_name': 'volume-1dbd4865-9f33-4af0-958f-09f45304f774', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccea3a07-c629-4ee9-8b86-85d838478f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccea3a07-c629-4ee9-8b86-85d838478f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e36240b7-dda4-4a3c-ae69-db5b09f41ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:29 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Volume 1dbd4865-9f33-4af0-958f-09f45304f774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dbd4865-9f33-4af0-958f-09f45304f774', 'volume_size': 1} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Flow 'volume_create_manager' (fc9d4e7f-d840-4ddc-ab8b-965cd5e2e636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cde401c-4f61-4901-98ae-b40e03dced53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cde401c-4f61-4901-98ae-b40e03dced53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4379693-a108-408c-8f90-8776da2506a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee5fafde026d48cf8b8ac00714a5c469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:29Z,use_quota=True,user_id='c5232eea2efb43e2bf1575120302e9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45c4744e-ed9f-48bb-a75f-2690647ea20a),volume_type_id=45c4744e-ed9f-48bb-a75f-2690647ea20a)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8429859a-5c15-4806-b850-f21f6e0865fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8429859a-5c15-4806-b850-f21f6e0865fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7958472b-55f7-4d11-a437-e806935715cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.image.glance [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Creating Keystone auth plugin from conf {{(pid=87119) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 19:06:29 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-81b15d9a-2fbe-455d-b3a6-ca7cfd260cbf tempest-VolumeDependencyTests-753308342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.275e2bde-83b8-4201-9253-bb2ed2a537e1" returned: 0 in 0.335s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Flow 'volume_create_manager' (5774e923-df49-4887-b09a-d9eada8879af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fc8df7d-a1b3-4efd-99d5-4a96d24e3c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fc8df7d-a1b3-4efd-99d5-4a96d24e3c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1709854365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13bde152-2d8f-42a4-aa4e-1104116e8b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d945e485696a4df7ba2f9d0452c7e446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:29Z,use_quota=True,user_id='8c446678ae7741888ecf6b6bb938b447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec73995b-612e-44bc-90a3-a5654fe9e346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec73995b-612e-44bc-90a3-a5654fe9e346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b0ac48-a16c-417c-b5aa-ae4d04cf95fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b0ac48-a16c-417c-b5aa-ae4d04cf95fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13bde152-2d8f-42a4-aa4e-1104116e8b7f', 'volume_name': 'volume-13bde152-2d8f-42a4-aa4e-1104116e8b7f', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (113b2391-1c03-4615-ac35-4d1acc714bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (113b2391-1c03-4615-ac35-4d1acc714bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656447a8-af80-4313-9247-1a6026a1b38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:29 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Volume 13bde152-2d8f-42a4-aa4e-1104116e8b7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13bde152-2d8f-42a4-aa4e-1104116e8b7f', 'volume_size': 1} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-81b15d9a-2fbe-455d-b3a6-ca7cfd260cbf tempest-VolumeDependencyTests-753308342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:29 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.info Nov 04 19:06:29 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7958472b-55f7-4d11-a437-e806935715cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd4379693-a108-408c-8f90-8776da2506a0', 'volume_name': 'volume-d4379693-a108-408c-8f90-8776da2506a0', 'volume_size': 1, 'image_id': 'c82773c9-6b1b-420d-b49d-b037b6275e15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c82773c9-6b1b-420d-b49d-b037b6275e15', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5aed98fe85926167df6977a8752a4668', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ee5fafde026d48cf8b8ac00714a5c469', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f345995618262aa157ed47432d40ae295a2dbe1724947817cdf72b5f84a69986f52b2af3915789e21bad85eceff06a1d8fc06ba568671ac7658e97c33786a835', 'id': 'c82773c9-6b1b-420d-b49d-b037b6275e15', 'created_at': datetime.datetime(2026, 11, 4, 18, 6, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 6, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c82773c9-6b1b-420d-b49d-b037b6275e15/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d2de35-ca0a-4af9-a771-a9857a27899f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d2de35-ca0a-4af9-a771-a9857a27899f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (977da666-f4d8-497f-b021-0b9b5b8f5939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:29 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Volume d4379693-a108-408c-8f90-8776da2506a0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d4379693-a108-408c-8f90-8776da2506a0', 'volume_size': 1, 'image_id': 'c82773c9-6b1b-420d-b49d-b037b6275e15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c82773c9-6b1b-420d-b49d-b037b6275e15', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5aed98fe85926167df6977a8752a4668', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ee5fafde026d48cf8b8ac00714a5c469', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f345995618262aa157ed47432d40ae295a2dbe1724947817cdf72b5f84a69986f52b2af3915789e21bad85eceff06a1d8fc06ba568671ac7658e97c33786a835', 'id': 'c82773c9-6b1b-420d-b49d-b037b6275e15', 'created_at': datetime.datetime(2026, 11, 4, 18, 6, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 6, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c82773c9-6b1b-420d-b49d-b037b6275e15/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Trying to clone d4379693-a108-408c-8f90-8776da2506a0 from image c82773c9-6b1b-420d-b49d-b037b6275e15 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c82773c9-6b1b-420d-b49d-b037b6275e15', 'metadata': {}}]). {{(pid=87119) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c82773c9-6b1b-420d-b49d-b037b6275e15_xxtrprf2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 19:06:29 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Image download 0.00 MB at 0.00 MB/s Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e2b950-d285-4413-a126-5d892f901fc2]: (4, 'raw') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c82773c9-6b1b-420d-b49d-b037b6275e15_xxtrprf2devstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Flow 'volume_create_manager' (e2f9be2c-e391-422c-8701-8f9d7b33df9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:30 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f24b6ce-3bd6-4359-ad92-05e9dcb7ec1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-81b15d9a-2fbe-455d-b3a6-ca7cfd260cbf tempest-VolumeDependencyTests-753308342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.info" returned: 0 in 0.355s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:30 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-81b15d9a-2fbe-455d-b3a6-ca7cfd260cbf tempest-VolumeDependencyTests-753308342 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.info is being set with open permissions: ugo+rw Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-81b15d9a-2fbe-455d-b3a6-ca7cfd260cbf tempest-VolumeDependencyTests-753308342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:30 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.info Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f24b6ce-3bd6-4359-ad92-05e9dcb7ec1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-27302820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03582d78-c1ad-4232-ba92-29049964d796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d945e485696a4df7ba2f9d0452c7e446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:30Z,use_quota=True,user_id='8c446678ae7741888ecf6b6bb938b447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:30 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c73b144-5a82-4630-b725-a1c3ef6bf0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c73b144-5a82-4630-b725-a1c3ef6bf0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b90f51aa-32a3-4eaa-abf2-d08fa9551880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b90f51aa-32a3-4eaa-abf2-d08fa9551880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03582d78-c1ad-4232-ba92-29049964d796', 'volume_name': 'volume-03582d78-c1ad-4232-ba92-29049964d796', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91c9df6-0b31-4460-bcab-e258e596f7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91c9df6-0b31-4460-bcab-e258e596f7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4276eba-2316-44ec-802d-2428f3a9f5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:30 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Volume 03582d78-c1ad-4232-ba92-29049964d796: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03582d78-c1ad-4232-ba92-29049964d796', 'volume_size': 1} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:30 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c82773c9-6b1b-420d-b49d-b037b6275e15_xxtrprf2devstack@QuobyteHD Nov 04 19:06:30 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:30 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-81b15d9a-2fbe-455d-b3a6-ca7cfd260cbf tempest-VolumeDependencyTests-753308342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.info" returned: 0 in 0.284s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-81b15d9a-2fbe-455d-b3a6-ca7cfd260cbf tempest-VolumeDependencyTests-753308342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.604s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-35710291-5417-419d-89fa-d9d3bd1fcd2d tempest-ProjectReaderTests-421706438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.013s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-35710291-5417-419d-89fa-d9d3bd1fcd2d tempest-ProjectReaderTests-421706438 None] Creating offline snapshot 5fdaa7f4-c3b0-4e37-b5be-7696f8d1845a of volume 11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2 {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[02499500-03ae-47ed-9e30-66632676334b]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-35710291-5417-419d-89fa-d9d3bd1fcd2d tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:30 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-81b15d9a-2fbe-455d-b3a6-ca7cfd260cbf tempest-VolumeDependencyTests-753308342 None] Create snapshot completed successfully Nov 04 19:06:30 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c82773c9-6b1b-420d-b49d-b037b6275e15_xxtrprf2devstack@QuobyteHD" returned: 0 in 0.467s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c82773c9-6b1b-420d-b49d-b037b6275e15_xxtrprf2devstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Flow 'volume_create_manager' (f8f35411-f165-478b-a2d4-55180bc4a284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af413b80-d7b6-4293-b721-0b0b4d85c05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af413b80-d7b6-4293-b721-0b0b4d85c05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1060611079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dbf27d3-f4bd-4cec-b9b2-c946254d1d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d945e485696a4df7ba2f9d0452c7e446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:30Z,use_quota=True,user_id='8c446678ae7741888ecf6b6bb938b447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f1d2f60-32e9-487e-a0e6-e14eec12e8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f1d2f60-32e9-487e-a0e6-e14eec12e8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:30 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2 Nov 04 19:06:30 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4345af7-bab7-4167-8bf8-75ddfdadffc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4345af7-bab7-4167-8bf8-75ddfdadffc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dbf27d3-f4bd-4cec-b9b2-c946254d1d99', 'volume_name': 'volume-4dbf27d3-f4bd-4cec-b9b2-c946254d1d99', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef2701f-c64e-4336-9104-b465bc7ee2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef2701f-c64e-4336-9104-b465bc7ee2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:30 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c82773c9-6b1b-420d-b49d-b037b6275e15_xxtrprf2devstack@QuobyteHD Nov 04 19:06:30 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e742b9-686c-463f-9b8c-66c63757f8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:30 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Volume 4dbf27d3-f4bd-4cec-b9b2-c946254d1d99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dbf27d3-f4bd-4cec-b9b2-c946254d1d99', 'volume_size': 1} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:30 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c82773c9-6b1b-420d-b49d-b037b6275e15_xxtrprf2devstack@QuobyteHD" returned: 1 in 0.335s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c82773c9-6b1b-420d-b49d-b037b6275e15_xxtrprf2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Temporary image c82773c9-6b1b-420d-b49d-b037b6275e15 is fetched for user c5232eea2efb43e2bf1575120302e9c2. {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 19:06:30 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-35710291-5417-419d-89fa-d9d3bd1fcd2d tempest-ProjectReaderTests-421706438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2" returned: 0 in 0.416s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-35710291-5417-419d-89fa-d9d3bd1fcd2d tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2.5fdaa7f4-c3b0-4e37-b5be-7696f8d1845a 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:30 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2.5fdaa7f4-c3b0-4e37-b5be-7696f8d1845a 1G Nov 04 19:06:30 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a06f40-a1fe-4425-8779-e2eb56be90d3]: (4, 'raw') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c82773c9-6b1b-420d-b49d-b037b6275e15_xxtrprf2devstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:30 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c82773c9-6b1b-420d-b49d-b037b6275e15_xxtrprf2devstack@QuobyteHD Nov 04 19:06:30 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:31 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Flow 'volume_create_manager' (e2388063-1b30-4030-8cb6-66122e47ff60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c83d45d-5636-4968-a7f2-bb1570c47a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c83d45d-5636-4968-a7f2-bb1570c47a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1087481581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90bf7e13-409f-46b7-98c2-b222b8b01919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa1d584a7944e3e9b506ae40a7aa4ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=275e2bde-83b8-4201-9253-bb2ed2a537e1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:31Z,use_quota=True,user_id='9ce4f38b97414d43910f30079f5ee476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:31 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e15cb1-23e9-4aed-be42-5acbae85de15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e15cb1-23e9-4aed-be42-5acbae85de15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (439cbb1e-ad98-440f-8b79-35809b0e5896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (439cbb1e-ad98-440f-8b79-35809b0e5896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '90bf7e13-409f-46b7-98c2-b222b8b01919', 'volume_name': 'volume-90bf7e13-409f-46b7-98c2-b222b8b01919', 'volume_size': 1, 'snapshot_id': '275e2bde-83b8-4201-9253-bb2ed2a537e1'}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d065b48-9624-4f44-9934-4d7503749c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d065b48-9624-4f44-9934-4d7503749c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:31 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d39a40-d8fa-496e-8687-81286a483ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:31 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Volume 90bf7e13-409f-46b7-98c2-b222b8b01919: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-90bf7e13-409f-46b7-98c2-b222b8b01919', 'volume_size': 1, 'snapshot_id': '275e2bde-83b8-4201-9253-bb2ed2a537e1'} Nov 04 19:06:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c82773c9-6b1b-420d-b49d-b037b6275e15_xxtrprf2devstack@QuobyteHD" returned: 0 in 0.444s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-35710291-5417-419d-89fa-d9d3bd1fcd2d tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2.5fdaa7f4-c3b0-4e37-b5be-7696f8d1845a 1G" returned: 0 in 0.498s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c82773c9-6b1b-420d-b49d-b037b6275e15_xxtrprf2devstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-35710291-5417-419d-89fa-d9d3bd1fcd2d tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2.5fdaa7f4-c3b0-4e37-b5be-7696f8d1845a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:31 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2.5fdaa7f4-c3b0-4e37-b5be-7696f8d1845a Nov 04 19:06:31 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:31 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c82773c9-6b1b-420d-b49d-b037b6275e15_xxtrprf2devstack@QuobyteHD Nov 04 19:06:31 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:31 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-35710291-5417-419d-89fa-d9d3bd1fcd2d tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2.5fdaa7f4-c3b0-4e37-b5be-7696f8d1845a" returned: 0 in 0.300s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:31 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-35710291-5417-419d-89fa-d9d3bd1fcd2d tempest-ProjectReaderTests-421706438 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2.5fdaa7f4-c3b0-4e37-b5be-7696f8d1845a is being set with open permissions: ugo+rw Nov 04 19:06:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-35710291-5417-419d-89fa-d9d3bd1fcd2d tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2.5fdaa7f4-c3b0-4e37-b5be-7696f8d1845a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:31 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c82773c9-6b1b-420d-b49d-b037b6275e15_xxtrprf2devstack@QuobyteHD" returned: 1 in 0.330s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c82773c9-6b1b-420d-b49d-b037b6275e15_xxtrprf2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:06:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:31 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2.5fdaa7f4-c3b0-4e37-b5be-7696f8d1845a Nov 04 19:06:31 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:31 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-35710291-5417-419d-89fa-d9d3bd1fcd2d tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2.5fdaa7f4-c3b0-4e37-b5be-7696f8d1845a" returned: 0 in 0.237s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-35710291-5417-419d-89fa-d9d3bd1fcd2d tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:31 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2.info Nov 04 19:06:31 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:32 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-35710291-5417-419d-89fa-d9d3bd1fcd2d tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2.info" returned: 0 in 0.249s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:32 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-35710291-5417-419d-89fa-d9d3bd1fcd2d tempest-ProjectReaderTests-421706438 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2.info is being set with open permissions: ugo+rw Nov 04 19:06:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-35710291-5417-419d-89fa-d9d3bd1fcd2d tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:32 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2.info Nov 04 19:06:32 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:32 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-35710291-5417-419d-89fa-d9d3bd1fcd2d tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2.info" returned: 0 in 0.246s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-35710291-5417-419d-89fa-d9d3bd1fcd2d tempest-ProjectReaderTests-421706438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.054s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.671s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-966367878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557ab331-d392-4f8f-ae9c-6062f6e664b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d945e485696a4df7ba2f9d0452c7e446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:29Z,use_quota=True,user_id='8c446678ae7741888ecf6b6bb938b447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Creating volume 557ab331-d392-4f8f-ae9c-6062f6e664b7 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:32 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:06:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-557ab331-d392-4f8f-ae9c-6062f6e664b7 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:32 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-557ab331-d392-4f8f-ae9c-6062f6e664b7 1073741824 Nov 04 19:06:32 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:32 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-35710291-5417-419d-89fa-d9d3bd1fcd2d tempest-ProjectReaderTests-421706438 None] Create snapshot completed successfully Nov 04 19:06:32 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6b0c8414-94ad-4280-a21c-bbd11d6fe03d tempest-ProjectReaderTests-421706438 None] Acquiring lock "cinder-5fdaa7f4-c3b0-4e37-b5be-7696f8d1845a-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:32 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6b0c8414-94ad-4280-a21c-bbd11d6fe03d tempest-ProjectReaderTests-421706438 None] Lock "cinder-5fdaa7f4-c3b0-4e37-b5be-7696f8d1845a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:32 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6b0c8414-94ad-4280-a21c-bbd11d6fe03d tempest-ProjectReaderTests-421706438 None] Acquiring lock "cinder-quobyte-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:32 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-557ab331-d392-4f8f-ae9c-6062f6e664b7 1073741824" returned: 0 in 0.438s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:32 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6b0c8414-94ad-4280-a21c-bbd11d6fe03d tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:32 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6b0c8414-94ad-4280-a21c-bbd11d6fe03d tempest-ProjectReaderTests-421706438 None] Acquiring lock "cinder-quobyte-5fdaa7f4-c3b0-4e37-b5be-7696f8d1845a" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:32 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6b0c8414-94ad-4280-a21c-bbd11d6fe03d tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-5fdaa7f4-c3b0-4e37-b5be-7696f8d1845a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-6b0c8414-94ad-4280-a21c-bbd11d6fe03d tempest-ProjectReaderTests-421706438 None] Deleting offline snapshot 5fdaa7f4-c3b0-4e37-b5be-7696f8d1845a of volume 11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:06:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-6b0c8414-94ad-4280-a21c-bbd11d6fe03d tempest-ProjectReaderTests-421706438 None] snapshot_file for this snap is: volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2.5fdaa7f4-c3b0-4e37-b5be-7696f8d1845a {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:06:32 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaa780f-934c-4c89-898f-dde1308be610]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6b0c8414-94ad-4280-a21c-bbd11d6fe03d tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2.5fdaa7f4-c3b0-4e37-b5be-7696f8d1845a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-557ab331-d392-4f8f-ae9c-6062f6e664b7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:32 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-557ab331-d392-4f8f-ae9c-6062f6e664b7 Nov 04 19:06:32 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:33 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2.5fdaa7f4-c3b0-4e37-b5be-7696f8d1845a Nov 04 19:06:33 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:33 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-557ab331-d392-4f8f-ae9c-6062f6e664b7" returned: 0 in 0.253s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.913s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1574815472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dbd4865-9f33-4af0-958f-09f45304f774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d945e485696a4df7ba2f9d0452c7e446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:29Z,use_quota=True,user_id='8c446678ae7741888ecf6b6bb938b447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Creating volume 1dbd4865-9f33-4af0-958f-09f45304f774 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:33 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1dbd4865-9f33-4af0-958f-09f45304f774 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c2b7487-29a6-4148-8f20-ff05f8daf3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-557ab331-d392-4f8f-ae9c-6062f6e664b7', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:33 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1dbd4865-9f33-4af0-958f-09f45304f774 1073741824 Nov 04 19:06:33 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60ab8a3-9f69-48cb-b9f9-7a29312f94ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:33 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Volume volume-557ab331-d392-4f8f-ae9c-6062f6e664b7 (557ab331-d392-4f8f-ae9c-6062f6e664b7): created successfully Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60ab8a3-9f69-48cb-b9f9-7a29312f94ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Flow 'volume_create_manager' (8c47737e-936e-406d-bd8d-2737a786a293) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:33 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-46b67364-7ce9-4b0c-af52-f5fdeffb2c84 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Created volume successfully. Nov 04 19:06:33 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6b0c8414-94ad-4280-a21c-bbd11d6fe03d tempest-ProjectReaderTests-421706438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2.5fdaa7f4-c3b0-4e37-b5be-7696f8d1845a" returned: 0 in 0.388s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-6b0c8414-94ad-4280-a21c-bbd11d6fe03d tempest-ProjectReaderTests-421706438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22ee7e1-1acd-462d-9fba-8fbb48244fb2]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6b0c8414-94ad-4280-a21c-bbd11d6fe03d tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:33 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2 Nov 04 19:06:33 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:33 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1dbd4865-9f33-4af0-958f-09f45304f774 1073741824" returned: 0 in 0.467s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1dbd4865-9f33-4af0-958f-09f45304f774 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:33 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1dbd4865-9f33-4af0-958f-09f45304f774 Nov 04 19:06:33 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:33 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6b0c8414-94ad-4280-a21c-bbd11d6fe03d tempest-ProjectReaderTests-421706438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2" returned: 0 in 0.424s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6b0c8414-94ad-4280-a21c-bbd11d6fe03d tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2.5fdaa7f4-c3b0-4e37-b5be-7696f8d1845a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:33 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2.5fdaa7f4-c3b0-4e37-b5be-7696f8d1845a Nov 04 19:06:33 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:33 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1dbd4865-9f33-4af0-958f-09f45304f774" returned: 0 in 0.254s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.314s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1709854365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13bde152-2d8f-42a4-aa4e-1104116e8b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d945e485696a4df7ba2f9d0452c7e446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:29Z,use_quota=True,user_id='8c446678ae7741888ecf6b6bb938b447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Creating volume 13bde152-2d8f-42a4-aa4e-1104116e8b7f {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:33 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:06:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13bde152-2d8f-42a4-aa4e-1104116e8b7f 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e36240b7-dda4-4a3c-ae69-db5b09f41ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dbd4865-9f33-4af0-958f-09f45304f774', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec86c4a8-f0c7-407a-81a4-e068c19a5847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:34 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13bde152-2d8f-42a4-aa4e-1104116e8b7f 1073741824 Nov 04 19:06:34 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:34 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Volume volume-1dbd4865-9f33-4af0-958f-09f45304f774 (1dbd4865-9f33-4af0-958f-09f45304f774): created successfully Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec86c4a8-f0c7-407a-81a4-e068c19a5847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Flow 'volume_create_manager' (fe353759-a858-4a40-a88e-750930c15c60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:34 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-aba57eeb-0023-414a-b450-e91b9cdc8748 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Created volume successfully. Nov 04 19:06:34 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6b0c8414-94ad-4280-a21c-bbd11d6fe03d tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2.5fdaa7f4-c3b0-4e37-b5be-7696f8d1845a" returned: 0 in 0.360s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6b0c8414-94ad-4280-a21c-bbd11d6fe03d tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2.5fdaa7f4-c3b0-4e37-b5be-7696f8d1845a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:34 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2.5fdaa7f4-c3b0-4e37-b5be-7696f8d1845a Nov 04 19:06:34 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:34 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6b0c8414-94ad-4280-a21c-bbd11d6fe03d tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2.5fdaa7f4-c3b0-4e37-b5be-7696f8d1845a" returned: 0 in 0.251s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6b0c8414-94ad-4280-a21c-bbd11d6fe03d tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-5fdaa7f4-c3b0-4e37-b5be-7696f8d1845a" released by "_delete_snapshot" :: held 1.534s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6b0c8414-94ad-4280-a21c-bbd11d6fe03d tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2" released by "delete_snapshot" :: held 1.564s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:34 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13bde152-2d8f-42a4-aa4e-1104116e8b7f 1073741824" returned: 0 in 0.455s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13bde152-2d8f-42a4-aa4e-1104116e8b7f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:34 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13bde152-2d8f-42a4-aa4e-1104116e8b7f Nov 04 19:06:34 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-6b0c8414-94ad-4280-a21c-bbd11d6fe03d tempest-ProjectReaderTests-421706438 None] Created reservations ['5a4560b9-bd63-4342-944c-466420d9ffef', '058977d4-ff43-48ba-aa65-c62f2e5cab2e', '88842ed5-0d4f-49db-a313-8739b09d8075', 'ea0c94a8-f997-4e05-acd0-45c6c0d9174d'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:34 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-6b0c8414-94ad-4280-a21c-bbd11d6fe03d tempest-ProjectReaderTests-421706438 None] Delete snapshot completed successfully. Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6b0c8414-94ad-4280-a21c-bbd11d6fe03d tempest-ProjectReaderTests-421706438 None] Lock "cinder-5fdaa7f4-c3b0-4e37-b5be-7696f8d1845a-delete_snapshot" released by "delete_snapshot" :: held 1.736s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:34 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13bde152-2d8f-42a4-aa4e-1104116e8b7f" returned: 0 in 0.236s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.584s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-27302820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03582d78-c1ad-4232-ba92-29049964d796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d945e485696a4df7ba2f9d0452c7e446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:30Z,use_quota=True,user_id='8c446678ae7741888ecf6b6bb938b447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Creating volume 03582d78-c1ad-4232-ba92-29049964d796 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:34 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-03582d78-c1ad-4232-ba92-29049964d796 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:34 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-03582d78-c1ad-4232-ba92-29049964d796 1073741824 Nov 04 19:06:34 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656447a8-af80-4313-9247-1a6026a1b38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13bde152-2d8f-42a4-aa4e-1104116e8b7f', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (666b75c7-571c-41f1-b6a3-60ac024ad8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:34 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Volume volume-13bde152-2d8f-42a4-aa4e-1104116e8b7f (13bde152-2d8f-42a4-aa4e-1104116e8b7f): created successfully Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (666b75c7-571c-41f1-b6a3-60ac024ad8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Flow 'volume_create_manager' (5774e923-df49-4887-b09a-d9eada8879af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:34 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-852aa0c9-3b9f-4811-88b3-6c0ce457871e tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Created volume successfully. Nov 04 19:06:34 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7429ac6d-470a-4265-8276-06e5cbc74a2f tempest-ProjectReaderTests-421706438 None] Acquiring lock "cinder-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7429ac6d-470a-4265-8276-06e5cbc74a2f tempest-ProjectReaderTests-421706438 None] Lock "cinder-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7429ac6d-470a-4265-8276-06e5cbc74a2f tempest-ProjectReaderTests-421706438 None] Acquiring lock "cinder-quobyte-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7429ac6d-470a-4265-8276-06e5cbc74a2f tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2" acquired by "delete_volume" :: waited 0.017s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb50714b-b2d8-4349-ba3d-b0e36bf95e44]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7429ac6d-470a-4265-8276-06e5cbc74a2f tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:35 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-03582d78-c1ad-4232-ba92-29049964d796 1073741824" returned: 0 in 0.451s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:35 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2 Nov 04 19:06:35 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-03582d78-c1ad-4232-ba92-29049964d796 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:35 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-03582d78-c1ad-4232-ba92-29049964d796 Nov 04 19:06:35 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:35 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:35 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7429ac6d-470a-4265-8276-06e5cbc74a2f tempest-ProjectReaderTests-421706438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2" returned: 0 in 0.375s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7429ac6d-470a-4265-8276-06e5cbc74a2f tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-03582d78-c1ad-4232-ba92-29049964d796" returned: 0 in 0.274s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.936s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1060611079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dbf27d3-f4bd-4cec-b9b2-c946254d1d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d945e485696a4df7ba2f9d0452c7e446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:30Z,use_quota=True,user_id='8c446678ae7741888ecf6b6bb938b447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Creating volume 4dbf27d3-f4bd-4cec-b9b2-c946254d1d99 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:35 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4dbf27d3-f4bd-4cec-b9b2-c946254d1d99 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:35 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2 Nov 04 19:06:35 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:35 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4dbf27d3-f4bd-4cec-b9b2-c946254d1d99 1073741824 Nov 04 19:06:35 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4276eba-2316-44ec-802d-2428f3a9f5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03582d78-c1ad-4232-ba92-29049964d796', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc7ecd9-f0da-4d66-a8c8-148211b4a904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:35 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Volume volume-03582d78-c1ad-4232-ba92-29049964d796 (03582d78-c1ad-4232-ba92-29049964d796): created successfully Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc7ecd9-f0da-4d66-a8c8-148211b4a904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Flow 'volume_create_manager' (e2f9be2c-e391-422c-8701-8f9d7b33df9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:35 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-deb17ece-69e6-4719-8df1-1069b8240325 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Created volume successfully. Nov 04 19:06:35 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7429ac6d-470a-4265-8276-06e5cbc74a2f tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2" returned: 0 in 0.282s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7429ac6d-470a-4265-8276-06e5cbc74a2f tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2" released by "delete_volume" :: held 0.740s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-7429ac6d-470a-4265-8276-06e5cbc74a2f tempest-ProjectReaderTests-421706438 None] Created reservations ['896a45ed-cf0e-4705-a184-9b2d7cbc90e8', '1996cff9-9463-4002-8c42-0e809d5a495b', '754384e8-2d00-4874-9aa3-78d08fc878a9', 'e56acc74-a858-4299-8d1f-885b0575e9f9'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7429ac6d-470a-4265-8276-06e5cbc74a2f tempest-ProjectReaderTests-421706438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7429ac6d-470a-4265-8276-06e5cbc74a2f tempest-ProjectReaderTests-421706438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7429ac6d-470a-4265-8276-06e5cbc74a2f tempest-ProjectReaderTests-421706438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7429ac6d-470a-4265-8276-06e5cbc74a2f tempest-ProjectReaderTests-421706438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7429ac6d-470a-4265-8276-06e5cbc74a2f tempest-ProjectReaderTests-421706438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7429ac6d-470a-4265-8276-06e5cbc74a2f tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:35 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:06:35 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:36 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4dbf27d3-f4bd-4cec-b9b2-c946254d1d99 1073741824" returned: 0 in 0.496s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4dbf27d3-f4bd-4cec-b9b2-c946254d1d99 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:36 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4dbf27d3-f4bd-4cec-b9b2-c946254d1d99 Nov 04 19:06:36 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:36 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7429ac6d-470a-4265-8276-06e5cbc74a2f tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.261s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-7429ac6d-470a-4265-8276-06e5cbc74a2f tempest-ProjectReaderTests-421706438 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:36 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-7429ac6d-470a-4265-8276-06e5cbc74a2f tempest-ProjectReaderTests-421706438 None] Deleted volume successfully. Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7429ac6d-470a-4265-8276-06e5cbc74a2f tempest-ProjectReaderTests-421706438 None] Lock "cinder-11e58c5a-8bd6-4b9d-be08-3d5ae7513bc2-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:36 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4dbf27d3-f4bd-4cec-b9b2-c946254d1d99" returned: 0 in 0.253s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.955s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Acquiring lock "cinder-quobyte-275e2bde-83b8-4201-9253-bb2ed2a537e1-90bf7e13-409f-46b7-98c2-b222b8b01919" by "_create_volume_from_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e742b9-686c-463f-9b8c-66c63757f8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dbf27d3-f4bd-4cec-b9b2-c946254d1d99', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa217cc-7679-4a33-8d36-954571836052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Lock "cinder-quobyte-275e2bde-83b8-4201-9253-bb2ed2a537e1-90bf7e13-409f-46b7-98c2-b222b8b01919" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Creating volume 90bf7e13-409f-46b7-98c2-b222b8b01919 from snapshot 275e2bde-83b8-4201-9253-bb2ed2a537e1 {{(pid=87119) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Acquiring lock "cinder-quobyte-90bf7e13-409f-46b7-98c2-b222b8b01919" by "_copy_volume_from_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:36 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Volume volume-4dbf27d3-f4bd-4cec-b9b2-c946254d1d99 (4dbf27d3-f4bd-4cec-b9b2-c946254d1d99): created successfully Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa217cc-7679-4a33-8d36-954571836052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Flow 'volume_create_manager' (f8f35411-f165-478b-a2d4-55180bc4a284) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Lock "cinder-quobyte-90bf7e13-409f-46b7-98c2-b222b8b01919" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] snapshot: 275e2bde-83b8-4201-9253-bb2ed2a537e1, volume: 90bf7e13-409f-46b7-98c2-b222b8b01919, {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:06:36 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-1062a642-babe-408f-9f0f-86ba7889540c tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Created volume successfully. Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d10fdc1-1074-422c-9114-64b9dcdea359]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.275e2bde-83b8-4201-9253-bb2ed2a537e1 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:36 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.275e2bde-83b8-4201-9253-bb2ed2a537e1 Nov 04 19:06:36 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Flow 'volume_create_manager' (e60ceeef-efcf-411e-be72-a1b60cef9bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e90d794-e1a2-4f50-98ec-091e9984ba8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e90d794-e1a2-4f50-98ec-091e9984ba8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-937054148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b71ef851-03c5-4ecb-83ab-2c10ebc29dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e06bd473564743b698ac5523d08c3fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:37Z,use_quota=True,user_id='6fc22b0379ef4e65ae31fdfa79981aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b62ead86-9400-4c69-96db-95249431c859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b62ead86-9400-4c69-96db-95249431c859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabf49b4-b72a-4861-aa09-a90e62ce7edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabf49b4-b72a-4861-aa09-a90e62ce7edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b71ef851-03c5-4ecb-83ab-2c10ebc29dd7', 'volume_name': 'volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68be38ae-4815-4a0a-a141-cd3020aae139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68be38ae-4815-4a0a-a141-cd3020aae139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955a4ce0-a54c-456a-9fdb-e0ea72b0eb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:36 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Volume b71ef851-03c5-4ecb-83ab-2c10ebc29dd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7', 'volume_size': 1} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:36 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.275e2bde-83b8-4201-9253-bb2ed2a537e1" returned: 0 in 0.373s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa42a0d-03e7-4272-9c23-5557f1e3c167]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:36 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7 Nov 04 19:06:36 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:37 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-86d71a89-32ff-440b-8710-f7ffac2804ea tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "cinder-4dbf27d3-f4bd-4cec-b9b2-c946254d1d99-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:37 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-86d71a89-32ff-440b-8710-f7ffac2804ea tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "cinder-4dbf27d3-f4bd-4cec-b9b2-c946254d1d99-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:37 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-86d71a89-32ff-440b-8710-f7ffac2804ea tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "cinder-quobyte-4dbf27d3-f4bd-4cec-b9b2-c946254d1d99" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:37 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-86d71a89-32ff-440b-8710-f7ffac2804ea tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "cinder-quobyte-4dbf27d3-f4bd-4cec-b9b2-c946254d1d99" acquired by "delete_volume" :: waited 0.018s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:37 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5006438f-5651-4926-b8d6-84f9e3ecfe61]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-86d71a89-32ff-440b-8710-f7ffac2804ea tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4dbf27d3-f4bd-4cec-b9b2-c946254d1d99 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:37 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4dbf27d3-f4bd-4cec-b9b2-c946254d1d99 Nov 04 19:06:37 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:37 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7" returned: 0 in 0.392s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7 {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:06:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Creating direct copy from snapshot {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:06:37 devstack cinder-volume[87119]: DEBUG cinder.utils [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Path /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-90bf7e13-409f-46b7-98c2-b222b8b01919 not found in is_blk_device check {{(pid=87119) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:06:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-90bf7e13-409f-46b7-98c2-b222b8b01919 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:37 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-90bf7e13-409f-46b7-98c2-b222b8b01919 Nov 04 19:06:37 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:37 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-86d71a89-32ff-440b-8710-f7ffac2804ea tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4dbf27d3-f4bd-4cec-b9b2-c946254d1d99" returned: 0 in 0.387s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-86d71a89-32ff-440b-8710-f7ffac2804ea tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4dbf27d3-f4bd-4cec-b9b2-c946254d1d99 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:37 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4dbf27d3-f4bd-4cec-b9b2-c946254d1d99 Nov 04 19:06:37 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:37 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-86d71a89-32ff-440b-8710-f7ffac2804ea tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4dbf27d3-f4bd-4cec-b9b2-c946254d1d99" returned: 0 in 0.340s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:37 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-86d71a89-32ff-440b-8710-f7ffac2804ea tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "cinder-quobyte-4dbf27d3-f4bd-4cec-b9b2-c946254d1d99" released by "delete_volume" :: held 0.798s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:37 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-86d71a89-32ff-440b-8710-f7ffac2804ea tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Created reservations ['6b984e03-d2e1-44da-863b-afd1eb6cbffa', '7075fc8a-a9f0-428c-81bb-1dfae001590f', '1641fa80-6bbf-495c-8a82-778ca4fc3e5e', 'fb21db64-1a02-44fc-aef9-da5ebeaa8b33'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-86d71a89-32ff-440b-8710-f7ffac2804ea tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-86d71a89-32ff-440b-8710-f7ffac2804ea tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-86d71a89-32ff-440b-8710-f7ffac2804ea tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-86d71a89-32ff-440b-8710-f7ffac2804ea tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-86d71a89-32ff-440b-8710-f7ffac2804ea tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-86d71a89-32ff-440b-8710-f7ffac2804ea tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:38 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:06:38 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6c7522cb-6ee0-41ff-9722-706397d5dc04 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "cinder-03582d78-c1ad-4232-ba92-29049964d796-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6c7522cb-6ee0-41ff-9722-706397d5dc04 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "cinder-03582d78-c1ad-4232-ba92-29049964d796-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6c7522cb-6ee0-41ff-9722-706397d5dc04 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "cinder-quobyte-03582d78-c1ad-4232-ba92-29049964d796" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6c7522cb-6ee0-41ff-9722-706397d5dc04 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "cinder-quobyte-03582d78-c1ad-4232-ba92-29049964d796" acquired by "delete_volume" :: waited 0.035s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:38 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c0634c-a401-46ec-8670-22094c9c5d81]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6c7522cb-6ee0-41ff-9722-706397d5dc04 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-03582d78-c1ad-4232-ba92-29049964d796 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:38 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-86d71a89-32ff-440b-8710-f7ffac2804ea tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.457s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:38 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-86d71a89-32ff-440b-8710-f7ffac2804ea tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:38 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-86d71a89-32ff-440b-8710-f7ffac2804ea tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Deleted volume successfully. Nov 04 19:06:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-86d71a89-32ff-440b-8710-f7ffac2804ea tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "cinder-4dbf27d3-f4bd-4cec-b9b2-c946254d1d99-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:38 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-03582d78-c1ad-4232-ba92-29049964d796 Nov 04 19:06:38 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:39 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6c7522cb-6ee0-41ff-9722-706397d5dc04 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-03582d78-c1ad-4232-ba92-29049964d796" returned: 0 in 0.749s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6c7522cb-6ee0-41ff-9722-706397d5dc04 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-03582d78-c1ad-4232-ba92-29049964d796 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:39 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-03582d78-c1ad-4232-ba92-29049964d796 Nov 04 19:06:39 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:39 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6c7522cb-6ee0-41ff-9722-706397d5dc04 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-03582d78-c1ad-4232-ba92-29049964d796" returned: 0 in 0.393s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:39 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6c7522cb-6ee0-41ff-9722-706397d5dc04 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "cinder-quobyte-03582d78-c1ad-4232-ba92-29049964d796" released by "delete_volume" :: held 1.239s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:39 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-6c7522cb-6ee0-41ff-9722-706397d5dc04 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Created reservations ['ec566649-5b9b-442b-8512-15699694eee6', 'fc9fb484-8a40-4a24-84ca-90a2b3bbf90e', '7501bac2-1893-4c30-a5c2-519ecd7e8bc5', '41ecc6b3-95ee-42bf-9cf6-efdc62dab04f'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6c7522cb-6ee0-41ff-9722-706397d5dc04 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6c7522cb-6ee0-41ff-9722-706397d5dc04 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:39 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-6c7522cb-6ee0-41ff-9722-706397d5dc04 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:39 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-6c7522cb-6ee0-41ff-9722-706397d5dc04 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6c7522cb-6ee0-41ff-9722-706397d5dc04 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6c7522cb-6ee0-41ff-9722-706397d5dc04 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:40 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:06:40 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:40 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6c7522cb-6ee0-41ff-9722-706397d5dc04 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.633s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:40 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-6c7522cb-6ee0-41ff-9722-706397d5dc04 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c971ac59-40b2-4c70-8bd3-a3c286d26353 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "cinder-13bde152-2d8f-42a4-aa4e-1104116e8b7f-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:40 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-6c7522cb-6ee0-41ff-9722-706397d5dc04 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Deleted volume successfully. Nov 04 19:06:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c971ac59-40b2-4c70-8bd3-a3c286d26353 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "cinder-13bde152-2d8f-42a4-aa4e-1104116e8b7f-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6c7522cb-6ee0-41ff-9722-706397d5dc04 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "cinder-03582d78-c1ad-4232-ba92-29049964d796-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c971ac59-40b2-4c70-8bd3-a3c286d26353 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "cinder-quobyte-13bde152-2d8f-42a4-aa4e-1104116e8b7f" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c971ac59-40b2-4c70-8bd3-a3c286d26353 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "cinder-quobyte-13bde152-2d8f-42a4-aa4e-1104116e8b7f" acquired by "delete_volume" :: waited 0.024s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:40 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca73503-0b6d-42fc-9d44-bcdb1aa3ede1]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c971ac59-40b2-4c70-8bd3-a3c286d26353 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13bde152-2d8f-42a4-aa4e-1104116e8b7f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:40 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13bde152-2d8f-42a4-aa4e-1104116e8b7f Nov 04 19:06:40 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:41 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c971ac59-40b2-4c70-8bd3-a3c286d26353 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13bde152-2d8f-42a4-aa4e-1104116e8b7f" returned: 0 in 0.513s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c971ac59-40b2-4c70-8bd3-a3c286d26353 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13bde152-2d8f-42a4-aa4e-1104116e8b7f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:41 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13bde152-2d8f-42a4-aa4e-1104116e8b7f Nov 04 19:06:41 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:41 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c971ac59-40b2-4c70-8bd3-a3c286d26353 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-13bde152-2d8f-42a4-aa4e-1104116e8b7f" returned: 0 in 0.330s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:41 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c971ac59-40b2-4c70-8bd3-a3c286d26353 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "cinder-quobyte-13bde152-2d8f-42a4-aa4e-1104116e8b7f" released by "delete_volume" :: held 0.938s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:41 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-c971ac59-40b2-4c70-8bd3-a3c286d26353 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Created reservations ['5deaa858-902d-49de-ad1e-c864b71a2f6e', 'cba32e74-42fe-443a-9674-6f5fe0c64a64', 'd5505749-bfbc-4e74-a355-d5cf7db6dc5b', '8e131edf-051c-4055-bff2-080e664e439a'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c971ac59-40b2-4c70-8bd3-a3c286d26353 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c971ac59-40b2-4c70-8bd3-a3c286d26353 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:41 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c971ac59-40b2-4c70-8bd3-a3c286d26353 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:41 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c971ac59-40b2-4c70-8bd3-a3c286d26353 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c971ac59-40b2-4c70-8bd3-a3c286d26353 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c971ac59-40b2-4c70-8bd3-a3c286d26353 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:41 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:06:41 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:42 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c971ac59-40b2-4c70-8bd3-a3c286d26353 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.334s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:42 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-c971ac59-40b2-4c70-8bd3-a3c286d26353 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:42 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-c971ac59-40b2-4c70-8bd3-a3c286d26353 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Deleted volume successfully. Nov 04 19:06:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c971ac59-40b2-4c70-8bd3-a3c286d26353 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "cinder-13bde152-2d8f-42a4-aa4e-1104116e8b7f-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5052a2e6-3bd0-470a-bc59-5c4cb24735e5 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "cinder-1dbd4865-9f33-4af0-958f-09f45304f774-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5052a2e6-3bd0-470a-bc59-5c4cb24735e5 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "cinder-1dbd4865-9f33-4af0-958f-09f45304f774-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5052a2e6-3bd0-470a-bc59-5c4cb24735e5 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "cinder-quobyte-1dbd4865-9f33-4af0-958f-09f45304f774" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5052a2e6-3bd0-470a-bc59-5c4cb24735e5 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "cinder-quobyte-1dbd4865-9f33-4af0-958f-09f45304f774" acquired by "delete_volume" :: waited 0.024s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:43 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df1bdeb-06d5-4339-ab93-1587de001aea]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5052a2e6-3bd0-470a-bc59-5c4cb24735e5 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1dbd4865-9f33-4af0-958f-09f45304f774 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:43 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1dbd4865-9f33-4af0-958f-09f45304f774 Nov 04 19:06:43 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:43 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5052a2e6-3bd0-470a-bc59-5c4cb24735e5 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1dbd4865-9f33-4af0-958f-09f45304f774" returned: 0 in 0.547s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:43 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5052a2e6-3bd0-470a-bc59-5c4cb24735e5 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1dbd4865-9f33-4af0-958f-09f45304f774 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:43 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1dbd4865-9f33-4af0-958f-09f45304f774 Nov 04 19:06:43 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:44 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5052a2e6-3bd0-470a-bc59-5c4cb24735e5 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1dbd4865-9f33-4af0-958f-09f45304f774" returned: 0 in 0.402s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5052a2e6-3bd0-470a-bc59-5c4cb24735e5 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "cinder-quobyte-1dbd4865-9f33-4af0-958f-09f45304f774" released by "delete_volume" :: held 1.040s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:44 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-90bf7e13-409f-46b7-98c2-b222b8b01919" returned: 0 in 7.046s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Image conversion details: src /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7, size 1024.00 MB, duration 7.05 sec, destination /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-90bf7e13-409f-46b7-98c2-b222b8b01919 {{(pid=87119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:06:44 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Converted 1024.00 MB image at 145.30 MB/s Nov 04 19:06:44 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-90bf7e13-409f-46b7-98c2-b222b8b01919 is being set with open permissions: ugo+rw Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-90bf7e13-409f-46b7-98c2-b222b8b01919 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-5052a2e6-3bd0-470a-bc59-5c4cb24735e5 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Created reservations ['4753321d-2134-4143-a514-989077a9d227', '96f14a04-ef73-458f-86ed-aeab285f805a', 'ef31c969-43c4-4f55-b110-b08d415b443f', 'eae94fe9-d35b-498d-bdba-41dca5dd76f9'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:44 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-90bf7e13-409f-46b7-98c2-b222b8b01919 Nov 04 19:06:44 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5052a2e6-3bd0-470a-bc59-5c4cb24735e5 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5052a2e6-3bd0-470a-bc59-5c4cb24735e5 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5052a2e6-3bd0-470a-bc59-5c4cb24735e5 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5052a2e6-3bd0-470a-bc59-5c4cb24735e5 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5052a2e6-3bd0-470a-bc59-5c4cb24735e5 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5052a2e6-3bd0-470a-bc59-5c4cb24735e5 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:44 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:06:44 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:44 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-90bf7e13-409f-46b7-98c2-b222b8b01919" returned: 0 in 0.261s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Lock "cinder-quobyte-90bf7e13-409f-46b7-98c2-b222b8b01919" released by "_copy_volume_from_snapshot" :: held 8.164s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Lock "cinder-quobyte-275e2bde-83b8-4201-9253-bb2ed2a537e1-90bf7e13-409f-46b7-98c2-b222b8b01919" released by "_create_volume_from_snapshot" :: held 8.248s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.291s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.943s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4379693-a108-408c-8f90-8776da2506a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee5fafde026d48cf8b8ac00714a5c469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:29Z,use_quota=True,user_id='c5232eea2efb43e2bf1575120302e9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45c4744e-ed9f-48bb-a75f-2690647ea20a),volume_type_id=45c4744e-ed9f-48bb-a75f-2690647ea20a)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Creating volume d4379693-a108-408c-8f90-8776da2506a0 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:44 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d4379693-a108-408c-8f90-8776da2506a0 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:44 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5052a2e6-3bd0-470a-bc59-5c4cb24735e5 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.259s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-5052a2e6-3bd0-470a-bc59-5c4cb24735e5 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:44 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d4379693-a108-408c-8f90-8776da2506a0 1073741824 Nov 04 19:06:44 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:44 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-5052a2e6-3bd0-470a-bc59-5c4cb24735e5 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Deleted volume successfully. Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d39a40-d8fa-496e-8687-81286a483ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90bf7e13-409f-46b7-98c2-b222b8b01919', 'volume_size': 1, 'snapshot_id': '275e2bde-83b8-4201-9253-bb2ed2a537e1'}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30fcfbbf-a91c-46ac-b677-f93d60e9bc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:44 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Volume volume-90bf7e13-409f-46b7-98c2-b222b8b01919 (90bf7e13-409f-46b7-98c2-b222b8b01919): created successfully Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30fcfbbf-a91c-46ac-b677-f93d60e9bc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Flow 'volume_create_manager' (e2388063-1b30-4030-8cb6-66122e47ff60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-5052a2e6-3bd0-470a-bc59-5c4cb24735e5 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "cinder-1dbd4865-9f33-4af0-958f-09f45304f774-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:44 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-3d7b600a-f36f-4510-9c04-3b68316694f3 tempest-VolumeDependencyTests-753308342 None] Created volume successfully. Nov 04 19:06:45 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d4379693-a108-408c-8f90-8776da2506a0 1073741824" returned: 0 in 0.400s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d4379693-a108-408c-8f90-8776da2506a0 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:45 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d4379693-a108-408c-8f90-8776da2506a0 Nov 04 19:06:45 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3d9d5aa7-ab11-4126-84db-dbc73a028b82 tempest-VolumeDependencyTests-753308342 None] Acquiring lock "cinder-275e2bde-83b8-4201-9253-bb2ed2a537e1-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3d9d5aa7-ab11-4126-84db-dbc73a028b82 tempest-VolumeDependencyTests-753308342 None] Lock "cinder-275e2bde-83b8-4201-9253-bb2ed2a537e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3d9d5aa7-ab11-4126-84db-dbc73a028b82 tempest-VolumeDependencyTests-753308342 None] Acquiring lock "cinder-quobyte-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3d9d5aa7-ab11-4126-84db-dbc73a028b82 tempest-VolumeDependencyTests-753308342 None] Lock "cinder-quobyte-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3d9d5aa7-ab11-4126-84db-dbc73a028b82 tempest-VolumeDependencyTests-753308342 None] Acquiring lock "cinder-quobyte-275e2bde-83b8-4201-9253-bb2ed2a537e1" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3d9d5aa7-ab11-4126-84db-dbc73a028b82 tempest-VolumeDependencyTests-753308342 None] Lock "cinder-quobyte-275e2bde-83b8-4201-9253-bb2ed2a537e1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-3d9d5aa7-ab11-4126-84db-dbc73a028b82 tempest-VolumeDependencyTests-753308342 None] Deleting offline snapshot 275e2bde-83b8-4201-9253-bb2ed2a537e1 of volume 12b0d4d8-52b4-4323-9f45-4b8af1cee1c7 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:06:45 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-3d9d5aa7-ab11-4126-84db-dbc73a028b82 tempest-VolumeDependencyTests-753308342 None] snapshot_file for this snap is: volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.275e2bde-83b8-4201-9253-bb2ed2a537e1 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d4379693-a108-408c-8f90-8776da2506a0" returned: 0 in 0.279s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.568s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-937054148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b71ef851-03c5-4ecb-83ab-2c10ebc29dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e06bd473564743b698ac5523d08c3fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:37Z,use_quota=True,user_id='6fc22b0379ef4e65ae31fdfa79981aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Creating volume b71ef851-03c5-4ecb-83ab-2c10ebc29dd7 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:45 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97bc298-81a2-431e-9352-8b4c75e5c7ec]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3d9d5aa7-ab11-4126-84db-dbc73a028b82 tempest-VolumeDependencyTests-753308342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.275e2bde-83b8-4201-9253-bb2ed2a537e1 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:45 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7 1073741824 Nov 04 19:06:45 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0cba34e3-9db9-40cb-8a60-7d385f3b7f41 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "cinder-557ab331-d392-4f8f-ae9c-6062f6e664b7-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Attempting download of c82773c9-6b1b-420d-b49d-b037b6275e15 ((None, [{'url': 'file:///opt/stack/data/glance/images/c82773c9-6b1b-420d-b49d-b037b6275e15', 'metadata': {}}])) to volume d4379693-a108-408c-8f90-8776da2506a0. {{(pid=87119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0cba34e3-9db9-40cb-8a60-7d385f3b7f41 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "cinder-557ab331-d392-4f8f-ae9c-6062f6e664b7-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0cba34e3-9db9-40cb-8a60-7d385f3b7f41 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "cinder-quobyte-557ab331-d392-4f8f-ae9c-6062f6e664b7" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0cba34e3-9db9-40cb-8a60-7d385f3b7f41 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "cinder-quobyte-557ab331-d392-4f8f-ae9c-6062f6e664b7" acquired by "delete_volume" :: waited 0.015s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:45 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.275e2bde-83b8-4201-9253-bb2ed2a537e1 Nov 04 19:06:45 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[9125651d-9cc2-4a7d-a613-699c955886f9]: (4, 'raw') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c82773c9-6b1b-420d-b49d-b037b6275e15_juu2a37l {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8b71ec-61a1-467e-ba4e-a5d206baae42]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0cba34e3-9db9-40cb-8a60-7d385f3b7f41 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-557ab331-d392-4f8f-ae9c-6062f6e664b7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:45 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c82773c9-6b1b-420d-b49d-b037b6275e15_juu2a37l Nov 04 19:06:45 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:45 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-557ab331-d392-4f8f-ae9c-6062f6e664b7 Nov 04 19:06:45 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:45 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3d9d5aa7-ab11-4126-84db-dbc73a028b82 tempest-VolumeDependencyTests-753308342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.275e2bde-83b8-4201-9253-bb2ed2a537e1" returned: 0 in 0.442s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-3d9d5aa7-ab11-4126-84db-dbc73a028b82 tempest-VolumeDependencyTests-753308342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72d6858-c852-43ff-8716-e5f4c9a2920a]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3d9d5aa7-ab11-4126-84db-dbc73a028b82 tempest-VolumeDependencyTests-753308342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:45 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7 1073741824" returned: 0 in 0.541s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:45 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c82773c9-6b1b-420d-b49d-b037b6275e15_juu2a37l" returned: 0 in 0.401s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c82773c9-6b1b-420d-b49d-b037b6275e15_juu2a37l {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:45 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7 Nov 04 19:06:45 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:45 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7 Nov 04 19:06:45 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:46 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0cba34e3-9db9-40cb-8a60-7d385f3b7f41 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-557ab331-d392-4f8f-ae9c-6062f6e664b7" returned: 0 in 0.433s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0cba34e3-9db9-40cb-8a60-7d385f3b7f41 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-557ab331-d392-4f8f-ae9c-6062f6e664b7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:46 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-557ab331-d392-4f8f-ae9c-6062f6e664b7 Nov 04 19:06:46 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:46 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c82773c9-6b1b-420d-b49d-b037b6275e15_juu2a37l Nov 04 19:06:46 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:46 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7" returned: 0 in 0.279s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955a4ce0-a54c-456a-9fdb-e0ea72b0eb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eda2250-e777-4827-8b52-db49aafa9f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:46 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Volume volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7 (b71ef851-03c5-4ecb-83ab-2c10ebc29dd7): created successfully Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eda2250-e777-4827-8b52-db49aafa9f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Flow 'volume_create_manager' (e60ceeef-efcf-411e-be72-a1b60cef9bce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:46 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-8f2629ea-b0b7-4d30-a4e0-996263f0340d tempest-ProjectReaderTests-421706438 None] Created volume successfully. Nov 04 19:06:46 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c82773c9-6b1b-420d-b49d-b037b6275e15_juu2a37l" returned: 1 in 0.349s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c82773c9-6b1b-420d-b49d-b037b6275e15_juu2a37l' failed. Not Retrying. {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:06:46 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0cba34e3-9db9-40cb-8a60-7d385f3b7f41 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-557ab331-d392-4f8f-ae9c-6062f6e664b7" returned: 0 in 0.300s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1d1b54-88bf-4d92-b75a-4f010f290156]: (4, 'raw') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c82773c9-6b1b-420d-b49d-b037b6275e15_xxtrprf2devstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0cba34e3-9db9-40cb-8a60-7d385f3b7f41 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "cinder-quobyte-557ab331-d392-4f8f-ae9c-6062f6e664b7" released by "delete_volume" :: held 0.818s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-0cba34e3-9db9-40cb-8a60-7d385f3b7f41 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Created reservations ['c6efff66-0232-4181-9535-b843332684b7', '31333022-179a-4bc5-852f-a911acf9c759', '954fe677-6500-4c8f-84db-4dfbb166e093', '800dbb15-b5f1-4531-9552-36cbd74dd9c3'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:46 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3d9d5aa7-ab11-4126-84db-dbc73a028b82 tempest-VolumeDependencyTests-753308342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7" returned: 0 in 0.581s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3d9d5aa7-ab11-4126-84db-dbc73a028b82 tempest-VolumeDependencyTests-753308342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.275e2bde-83b8-4201-9253-bb2ed2a537e1 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:46 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c82773c9-6b1b-420d-b49d-b037b6275e15_xxtrprf2devstack@QuobyteHD Nov 04 19:06:46 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:46 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.275e2bde-83b8-4201-9253-bb2ed2a537e1 Nov 04 19:06:46 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0cba34e3-9db9-40cb-8a60-7d385f3b7f41 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0cba34e3-9db9-40cb-8a60-7d385f3b7f41 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0cba34e3-9db9-40cb-8a60-7d385f3b7f41 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-0cba34e3-9db9-40cb-8a60-7d385f3b7f41 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-0cba34e3-9db9-40cb-8a60-7d385f3b7f41 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0cba34e3-9db9-40cb-8a60-7d385f3b7f41 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:46 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:06:46 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b420dd47-c590-4f30-8e47-7d8e635af6b9 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "cinder-1e76519d-b1c1-4833-bbed-f37e4ca1e021-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b420dd47-c590-4f30-8e47-7d8e635af6b9 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "cinder-1e76519d-b1c1-4833-bbed-f37e4ca1e021-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:46 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c82773c9-6b1b-420d-b49d-b037b6275e15_xxtrprf2devstack@QuobyteHD" returned: 0 in 0.424s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c82773c9-6b1b-420d-b49d-b037b6275e15_xxtrprf2devstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b420dd47-c590-4f30-8e47-7d8e635af6b9 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "cinder-quobyte-1e76519d-b1c1-4833-bbed-f37e4ca1e021" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b420dd47-c590-4f30-8e47-7d8e635af6b9 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "cinder-quobyte-1e76519d-b1c1-4833-bbed-f37e4ca1e021" acquired by "delete_volume" :: waited 0.035s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[449c69ab-9ca1-43b1-a552-cee6779ef3db]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b420dd47-c590-4f30-8e47-7d8e635af6b9 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1e76519d-b1c1-4833-bbed-f37e4ca1e021 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:46 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-0cba34e3-9db9-40cb-8a60-7d385f3b7f41 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.420s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-0cba34e3-9db9-40cb-8a60-7d385f3b7f41 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:46 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-0cba34e3-9db9-40cb-8a60-7d385f3b7f41 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Deleted volume successfully. Nov 04 19:06:46 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c82773c9-6b1b-420d-b49d-b037b6275e15_xxtrprf2devstack@QuobyteHD Nov 04 19:06:46 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-0cba34e3-9db9-40cb-8a60-7d385f3b7f41 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "cinder-557ab331-d392-4f8f-ae9c-6062f6e664b7-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:46 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3d9d5aa7-ab11-4126-84db-dbc73a028b82 tempest-VolumeDependencyTests-753308342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.275e2bde-83b8-4201-9253-bb2ed2a537e1" returned: 0 in 0.581s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3d9d5aa7-ab11-4126-84db-dbc73a028b82 tempest-VolumeDependencyTests-753308342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.275e2bde-83b8-4201-9253-bb2ed2a537e1 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8fec36c5-25ea-4030-a75c-8b2dbf2de24e tempest-ProjectReaderTests-421706438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8fec36c5-25ea-4030-a75c-8b2dbf2de24e tempest-ProjectReaderTests-421706438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:47 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.275e2bde-83b8-4201-9253-bb2ed2a537e1 Nov 04 19:06:47 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:47 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1e76519d-b1c1-4833-bbed-f37e4ca1e021 Nov 04 19:06:47 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-8fec36c5-25ea-4030-a75c-8b2dbf2de24e tempest-ProjectReaderTests-421706438 None] Creating offline snapshot 971bcdb8-9ee9-468e-852a-04fb5f691dca of volume b71ef851-03c5-4ecb-83ab-2c10ebc29dd7 {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe747f9-aafd-4afc-8252-c637deac3550]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8fec36c5-25ea-4030-a75c-8b2dbf2de24e tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:47 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c82773c9-6b1b-420d-b49d-b037b6275e15_xxtrprf2devstack@QuobyteHD" returned: 1 in 0.418s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c82773c9-6b1b-420d-b49d-b037b6275e15_xxtrprf2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] c82773c9-6b1b-420d-b49d-b037b6275e15 was raw, converting to qcow2 {{(pid=87119) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c82773c9-6b1b-420d-b49d-b037b6275e15_xxtrprf2devstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d4379693-a108-408c-8f90-8776da2506a0 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:47 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c82773c9-6b1b-420d-b49d-b037b6275e15_xxtrprf2devstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d4379693-a108-408c-8f90-8776da2506a0 Nov 04 19:06:47 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:47 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7 Nov 04 19:06:47 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:47 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:47 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3d9d5aa7-ab11-4126-84db-dbc73a028b82 tempest-VolumeDependencyTests-753308342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7.275e2bde-83b8-4201-9253-bb2ed2a537e1" returned: 0 in 0.388s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b420dd47-c590-4f30-8e47-7d8e635af6b9 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1e76519d-b1c1-4833-bbed-f37e4ca1e021" returned: 0 in 0.556s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b420dd47-c590-4f30-8e47-7d8e635af6b9 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1e76519d-b1c1-4833-bbed-f37e4ca1e021 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:47 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1e76519d-b1c1-4833-bbed-f37e4ca1e021 Nov 04 19:06:47 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3d9d5aa7-ab11-4126-84db-dbc73a028b82 tempest-VolumeDependencyTests-753308342 None] Lock "cinder-quobyte-275e2bde-83b8-4201-9253-bb2ed2a537e1" released by "_delete_snapshot" :: held 2.150s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3d9d5aa7-ab11-4126-84db-dbc73a028b82 tempest-VolumeDependencyTests-753308342 None] Lock "cinder-quobyte-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7" released by "delete_snapshot" :: held 2.176s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-3d9d5aa7-ab11-4126-84db-dbc73a028b82 tempest-VolumeDependencyTests-753308342 None] Created reservations ['5df17e7e-25d1-4480-86f8-a96d09fea338', '5fe8ca4e-44fc-40f5-bd42-08b9be326c9f', '60e0a73c-733b-4317-953c-711a7bf87b2e', 'c04adb61-08f4-4147-b472-5a5d51eb4628'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:47 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8fec36c5-25ea-4030-a75c-8b2dbf2de24e tempest-ProjectReaderTests-421706438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7" returned: 0 in 0.477s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8fec36c5-25ea-4030-a75c-8b2dbf2de24e tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7.971bcdb8-9ee9-468e-852a-04fb5f691dca 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:47 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7.971bcdb8-9ee9-468e-852a-04fb5f691dca 1G Nov 04 19:06:47 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:47 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-3d9d5aa7-ab11-4126-84db-dbc73a028b82 tempest-VolumeDependencyTests-753308342 None] Delete snapshot completed successfully. Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3d9d5aa7-ab11-4126-84db-dbc73a028b82 tempest-VolumeDependencyTests-753308342 None] Lock "cinder-275e2bde-83b8-4201-9253-bb2ed2a537e1-delete_snapshot" released by "delete_snapshot" :: held 2.376s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:47 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b420dd47-c590-4f30-8e47-7d8e635af6b9 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1e76519d-b1c1-4833-bbed-f37e4ca1e021" returned: 0 in 0.363s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b420dd47-c590-4f30-8e47-7d8e635af6b9 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "cinder-quobyte-1e76519d-b1c1-4833-bbed-f37e4ca1e021" released by "delete_volume" :: held 0.980s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:47 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c82773c9-6b1b-420d-b49d-b037b6275e15_xxtrprf2devstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d4379693-a108-408c-8f90-8776da2506a0" returned: 0 in 0.610s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c82773c9-6b1b-420d-b49d-b037b6275e15_xxtrprf2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d4379693-a108-408c-8f90-8776da2506a0 {{(pid=87119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:06:47 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Converted 0.00 MB image at 0.00 MB/s Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d4379693-a108-408c-8f90-8776da2506a0 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:47 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d4379693-a108-408c-8f90-8776da2506a0 1G Nov 04 19:06:47 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-b420dd47-c590-4f30-8e47-7d8e635af6b9 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Created reservations ['3e7ea158-d660-438b-ae1a-a61f8ecbb1c6', 'c5ce6f9c-ca1b-4fbf-922f-2c5d2632eb73', '7301542c-e6cb-4e81-8c59-591e2c7c1cc7', '329ebb7d-df8e-48a1-8d8f-a4ce19bec861'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b420dd47-c590-4f30-8e47-7d8e635af6b9 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b420dd47-c590-4f30-8e47-7d8e635af6b9 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-b420dd47-c590-4f30-8e47-7d8e635af6b9 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-b420dd47-c590-4f30-8e47-7d8e635af6b9 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b420dd47-c590-4f30-8e47-7d8e635af6b9 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b420dd47-c590-4f30-8e47-7d8e635af6b9 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:47 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:06:47 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:48 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8fec36c5-25ea-4030-a75c-8b2dbf2de24e tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7.971bcdb8-9ee9-468e-852a-04fb5f691dca 1G" returned: 0 in 0.523s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8fec36c5-25ea-4030-a75c-8b2dbf2de24e tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7.971bcdb8-9ee9-468e-852a-04fb5f691dca {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:48 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7.971bcdb8-9ee9-468e-852a-04fb5f691dca Nov 04 19:06:48 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:48 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d4379693-a108-408c-8f90-8776da2506a0 1G" returned: 0 in 0.333s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Downloaded image c82773c9-6b1b-420d-b49d-b037b6275e15 ((None, [{'url': 'file:///opt/stack/data/glance/images/c82773c9-6b1b-420d-b49d-b037b6275e15', 'metadata': {}}])) to volume d4379693-a108-408c-8f90-8776da2506a0 successfully. {{(pid=87119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Temporary image c82773c9-6b1b-420d-b49d-b037b6275e15 for user c5232eea2efb43e2bf1575120302e9c2 is deleted. {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Marking volume d4379693-a108-408c-8f90-8776da2506a0 as bootable. {{(pid=87119) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Copying metadata from image c82773c9-6b1b-420d-b49d-b037b6275e15 to d4379693-a108-408c-8f90-8776da2506a0. {{(pid=87119) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Creating volume glance metadata for volume d4379693-a108-408c-8f90-8776da2506a0 backed by image c82773c9-6b1b-420d-b49d-b037b6275e15 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c82773c9-6b1b-420d-b49d-b037b6275e15', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5aed98fe85926167df6977a8752a4668', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87119) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 19:06:48 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b420dd47-c590-4f30-8e47-7d8e635af6b9 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.270s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-b420dd47-c590-4f30-8e47-7d8e635af6b9 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:48 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-b420dd47-c590-4f30-8e47-7d8e635af6b9 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Deleted volume successfully. Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (977da666-f4d8-497f-b021-0b9b5b8f5939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4379693-a108-408c-8f90-8776da2506a0', 'volume_size': 1, 'image_id': 'c82773c9-6b1b-420d-b49d-b037b6275e15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c82773c9-6b1b-420d-b49d-b037b6275e15', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5aed98fe85926167df6977a8752a4668', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ee5fafde026d48cf8b8ac00714a5c469', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f345995618262aa157ed47432d40ae295a2dbe1724947817cdf72b5f84a69986f52b2af3915789e21bad85eceff06a1d8fc06ba568671ac7658e97c33786a835', 'id': 'c82773c9-6b1b-420d-b49d-b037b6275e15', 'created_at': datetime.datetime(2026, 11, 4, 18, 6, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 6, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c82773c9-6b1b-420d-b49d-b037b6275e15/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e50916d5-d8cb-47cc-ab69-e2ffbef95b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b420dd47-c590-4f30-8e47-7d8e635af6b9 tempest-CreateVolumesFromSourceVolumeTest-1838136452 None] Lock "cinder-1e76519d-b1c1-4833-bbed-f37e4ca1e021-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:48 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Volume volume-d4379693-a108-408c-8f90-8776da2506a0 (d4379693-a108-408c-8f90-8776da2506a0): created successfully Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e50916d5-d8cb-47cc-ab69-e2ffbef95b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Flow 'volume_create_manager' (fc9d4e7f-d840-4ddc-ab8b-965cd5e2e636) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:48 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-1a8346f6-f124-4f4e-a3b3-6bc76de6c266 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Created volume successfully. Nov 04 19:06:48 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8fec36c5-25ea-4030-a75c-8b2dbf2de24e tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7.971bcdb8-9ee9-468e-852a-04fb5f691dca" returned: 0 in 0.328s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:48 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-8fec36c5-25ea-4030-a75c-8b2dbf2de24e tempest-ProjectReaderTests-421706438 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7.971bcdb8-9ee9-468e-852a-04fb5f691dca is being set with open permissions: ugo+rw Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8fec36c5-25ea-4030-a75c-8b2dbf2de24e tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7.971bcdb8-9ee9-468e-852a-04fb5f691dca {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:48 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7.971bcdb8-9ee9-468e-852a-04fb5f691dca Nov 04 19:06:48 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c07ec95c-2117-4647-9f4c-be168f54e1ae tempest-VolumeDependencyTests-753308342 None] Acquiring lock "cinder-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c07ec95c-2117-4647-9f4c-be168f54e1ae tempest-VolumeDependencyTests-753308342 None] Lock "cinder-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c07ec95c-2117-4647-9f4c-be168f54e1ae tempest-VolumeDependencyTests-753308342 None] Acquiring lock "cinder-quobyte-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c07ec95c-2117-4647-9f4c-be168f54e1ae tempest-VolumeDependencyTests-753308342 None] Lock "cinder-quobyte-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7" acquired by "delete_volume" :: waited 0.018s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8107346-c8a9-4cfa-988d-5d2e45e58a81]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c07ec95c-2117-4647-9f4c-be168f54e1ae tempest-VolumeDependencyTests-753308342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:48 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8fec36c5-25ea-4030-a75c-8b2dbf2de24e tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7.971bcdb8-9ee9-468e-852a-04fb5f691dca" returned: 0 in 0.311s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:48 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7 Nov 04 19:06:48 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8fec36c5-25ea-4030-a75c-8b2dbf2de24e tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f436453d-fb3c-4051-b914-70f8e98af1e3 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Acquiring lock "cinder-d4379693-a108-408c-8f90-8776da2506a0-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:48 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7.info Nov 04 19:06:48 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f436453d-fb3c-4051-b914-70f8e98af1e3 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Lock "cinder-d4379693-a108-408c-8f90-8776da2506a0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f436453d-fb3c-4051-b914-70f8e98af1e3 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Acquiring lock "cinder-quobyte-d4379693-a108-408c-8f90-8776da2506a0" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f436453d-fb3c-4051-b914-70f8e98af1e3 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Lock "cinder-quobyte-d4379693-a108-408c-8f90-8776da2506a0" acquired by "delete_volume" :: waited 0.024s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[82192f9f-1841-4c71-bd73-ed0aed71055a]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f436453d-fb3c-4051-b914-70f8e98af1e3 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d4379693-a108-408c-8f90-8776da2506a0 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:49 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d4379693-a108-408c-8f90-8776da2506a0 Nov 04 19:06:49 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:49 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c07ec95c-2117-4647-9f4c-be168f54e1ae tempest-VolumeDependencyTests-753308342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7" returned: 0 in 0.486s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c07ec95c-2117-4647-9f4c-be168f54e1ae tempest-VolumeDependencyTests-753308342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:49 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8fec36c5-25ea-4030-a75c-8b2dbf2de24e tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7.info" returned: 0 in 0.346s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:49 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-8fec36c5-25ea-4030-a75c-8b2dbf2de24e tempest-ProjectReaderTests-421706438 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7.info is being set with open permissions: ugo+rw Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8fec36c5-25ea-4030-a75c-8b2dbf2de24e tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:49 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7 Nov 04 19:06:49 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:49 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7.info Nov 04 19:06:49 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:49 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c07ec95c-2117-4647-9f4c-be168f54e1ae tempest-VolumeDependencyTests-753308342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7" returned: 0 in 0.274s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c07ec95c-2117-4647-9f4c-be168f54e1ae tempest-VolumeDependencyTests-753308342 None] Lock "cinder-quobyte-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7" released by "delete_volume" :: held 0.837s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:49 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f436453d-fb3c-4051-b914-70f8e98af1e3 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d4379693-a108-408c-8f90-8776da2506a0" returned: 0 in 0.466s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f436453d-fb3c-4051-b914-70f8e98af1e3 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d4379693-a108-408c-8f90-8776da2506a0 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:49 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8fec36c5-25ea-4030-a75c-8b2dbf2de24e tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7.info" returned: 0 in 0.303s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:49 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d4379693-a108-408c-8f90-8776da2506a0 Nov 04 19:06:49 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8fec36c5-25ea-4030-a75c-8b2dbf2de24e tempest-ProjectReaderTests-421706438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.412s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:49 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-8fec36c5-25ea-4030-a75c-8b2dbf2de24e tempest-ProjectReaderTests-421706438 None] Create snapshot completed successfully Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-c07ec95c-2117-4647-9f4c-be168f54e1ae tempest-VolumeDependencyTests-753308342 None] Created reservations ['98d07d25-0c0d-4930-b422-ccfbba35b614', '6939a502-ba7d-4a39-8750-36e09859d43e', '95206bf1-34e0-45f4-88a6-0d8cc09f8064', '92e9ffc7-74eb-451e-9f0e-f71262433bd5'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c07ec95c-2117-4647-9f4c-be168f54e1ae tempest-VolumeDependencyTests-753308342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c07ec95c-2117-4647-9f4c-be168f54e1ae tempest-VolumeDependencyTests-753308342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c07ec95c-2117-4647-9f4c-be168f54e1ae tempest-VolumeDependencyTests-753308342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-c07ec95c-2117-4647-9f4c-be168f54e1ae tempest-VolumeDependencyTests-753308342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-c07ec95c-2117-4647-9f4c-be168f54e1ae tempest-VolumeDependencyTests-753308342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c07ec95c-2117-4647-9f4c-be168f54e1ae tempest-VolumeDependencyTests-753308342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:49 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:06:49 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-06f9eb79-1f64-4191-b711-1798a8a778de tempest-VolumeDependencyTests-753308342 None] Acquiring lock "cinder-90bf7e13-409f-46b7-98c2-b222b8b01919-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:49 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f436453d-fb3c-4051-b914-70f8e98af1e3 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-d4379693-a108-408c-8f90-8776da2506a0" returned: 0 in 0.323s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-06f9eb79-1f64-4191-b711-1798a8a778de tempest-VolumeDependencyTests-753308342 None] Lock "cinder-90bf7e13-409f-46b7-98c2-b222b8b01919-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f436453d-fb3c-4051-b914-70f8e98af1e3 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Lock "cinder-quobyte-d4379693-a108-408c-8f90-8776da2506a0" released by "delete_volume" :: held 0.867s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-06f9eb79-1f64-4191-b711-1798a8a778de tempest-VolumeDependencyTests-753308342 None] Acquiring lock "cinder-quobyte-90bf7e13-409f-46b7-98c2-b222b8b01919" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-06f9eb79-1f64-4191-b711-1798a8a778de tempest-VolumeDependencyTests-753308342 None] Lock "cinder-quobyte-90bf7e13-409f-46b7-98c2-b222b8b01919" acquired by "delete_volume" :: waited 0.025s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-f436453d-fb3c-4051-b914-70f8e98af1e3 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Created reservations ['aad36618-a598-4c15-bff3-2a2cad5c4a41', '0160140d-0d51-4389-b5e7-0dbcc56d9642', '7810bf87-8d05-4fee-8253-60760d661882', '4cc75446-b622-4695-9e90-15ed11e3b509'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[921ff678-df8e-41eb-a7dc-2c145823f133]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-06f9eb79-1f64-4191-b711-1798a8a778de tempest-VolumeDependencyTests-753308342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-90bf7e13-409f-46b7-98c2-b222b8b01919 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:49 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-c07ec95c-2117-4647-9f4c-be168f54e1ae tempest-VolumeDependencyTests-753308342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.383s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-c07ec95c-2117-4647-9f4c-be168f54e1ae tempest-VolumeDependencyTests-753308342 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:49 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-c07ec95c-2117-4647-9f4c-be168f54e1ae tempest-VolumeDependencyTests-753308342 None] Deleted volume successfully. Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f436453d-fb3c-4051-b914-70f8e98af1e3 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f436453d-fb3c-4051-b914-70f8e98af1e3 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:49 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f436453d-fb3c-4051-b914-70f8e98af1e3 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:50 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-90bf7e13-409f-46b7-98c2-b222b8b01919 Nov 04 19:06:50 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f436453d-fb3c-4051-b914-70f8e98af1e3 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f436453d-fb3c-4051-b914-70f8e98af1e3 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f436453d-fb3c-4051-b914-70f8e98af1e3 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-c07ec95c-2117-4647-9f4c-be168f54e1ae tempest-VolumeDependencyTests-753308342 None] Lock "cinder-12b0d4d8-52b4-4323-9f45-4b8af1cee1c7-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:50 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:06:50 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3f28f646-7142-496f-bbeb-c2cf2f0958e3 tempest-ProjectReaderTests-421706438 None] Acquiring lock "cinder-971bcdb8-9ee9-468e-852a-04fb5f691dca-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3f28f646-7142-496f-bbeb-c2cf2f0958e3 tempest-ProjectReaderTests-421706438 None] Lock "cinder-971bcdb8-9ee9-468e-852a-04fb5f691dca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3f28f646-7142-496f-bbeb-c2cf2f0958e3 tempest-ProjectReaderTests-421706438 None] Acquiring lock "cinder-quobyte-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3f28f646-7142-496f-bbeb-c2cf2f0958e3 tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3f28f646-7142-496f-bbeb-c2cf2f0958e3 tempest-ProjectReaderTests-421706438 None] Acquiring lock "cinder-quobyte-971bcdb8-9ee9-468e-852a-04fb5f691dca" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3f28f646-7142-496f-bbeb-c2cf2f0958e3 tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-971bcdb8-9ee9-468e-852a-04fb5f691dca" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-3f28f646-7142-496f-bbeb-c2cf2f0958e3 tempest-ProjectReaderTests-421706438 None] Deleting offline snapshot 971bcdb8-9ee9-468e-852a-04fb5f691dca of volume b71ef851-03c5-4ecb-83ab-2c10ebc29dd7 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:06:50 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-3f28f646-7142-496f-bbeb-c2cf2f0958e3 tempest-ProjectReaderTests-421706438 None] snapshot_file for this snap is: volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7.971bcdb8-9ee9-468e-852a-04fb5f691dca {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-06f9eb79-1f64-4191-b711-1798a8a778de tempest-VolumeDependencyTests-753308342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-90bf7e13-409f-46b7-98c2-b222b8b01919" returned: 0 in 0.554s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-06f9eb79-1f64-4191-b711-1798a8a778de tempest-VolumeDependencyTests-753308342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-90bf7e13-409f-46b7-98c2-b222b8b01919 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fde116d-983a-467a-9e13-4e738d7b6301]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:50 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3f28f646-7142-496f-bbeb-c2cf2f0958e3 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7.971bcdb8-9ee9-468e-852a-04fb5f691dca {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f436453d-fb3c-4051-b914-70f8e98af1e3 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.446s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-f436453d-fb3c-4051-b914-70f8e98af1e3 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:50 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-f436453d-fb3c-4051-b914-70f8e98af1e3 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Deleted volume successfully. Nov 04 19:06:50 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-90bf7e13-409f-46b7-98c2-b222b8b01919 Nov 04 19:06:50 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f436453d-fb3c-4051-b914-70f8e98af1e3 tempest-VolumeAndVolumeTypeFromImageTest-107146256 None] Lock "cinder-d4379693-a108-408c-8f90-8776da2506a0-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:50 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7.971bcdb8-9ee9-468e-852a-04fb5f691dca Nov 04 19:06:50 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:50 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-06f9eb79-1f64-4191-b711-1798a8a778de tempest-VolumeDependencyTests-753308342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-90bf7e13-409f-46b7-98c2-b222b8b01919" returned: 0 in 0.316s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-06f9eb79-1f64-4191-b711-1798a8a778de tempest-VolumeDependencyTests-753308342 None] Lock "cinder-quobyte-90bf7e13-409f-46b7-98c2-b222b8b01919" released by "delete_volume" :: held 0.922s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-06f9eb79-1f64-4191-b711-1798a8a778de tempest-VolumeDependencyTests-753308342 None] Created reservations ['16d77e43-81c7-4bb9-bfec-9600d5c39ffc', 'c3e8ce97-1b5e-41c0-889a-ea4c34201258', 'da215598-b37a-440c-b3a3-549fb88ce9e8', '1e826288-9971-4cec-9b92-32e606206ef6'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-06f9eb79-1f64-4191-b711-1798a8a778de tempest-VolumeDependencyTests-753308342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-06f9eb79-1f64-4191-b711-1798a8a778de tempest-VolumeDependencyTests-753308342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-06f9eb79-1f64-4191-b711-1798a8a778de tempest-VolumeDependencyTests-753308342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-06f9eb79-1f64-4191-b711-1798a8a778de tempest-VolumeDependencyTests-753308342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-06f9eb79-1f64-4191-b711-1798a8a778de tempest-VolumeDependencyTests-753308342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-06f9eb79-1f64-4191-b711-1798a8a778de tempest-VolumeDependencyTests-753308342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:50 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:06:50 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:50 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3f28f646-7142-496f-bbeb-c2cf2f0958e3 tempest-ProjectReaderTests-421706438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7.971bcdb8-9ee9-468e-852a-04fb5f691dca" returned: 0 in 0.513s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:50 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-3f28f646-7142-496f-bbeb-c2cf2f0958e3 tempest-ProjectReaderTests-421706438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:06:51 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[040af6a7-e825-42cf-ba06-ef5d2107722a]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3f28f646-7142-496f-bbeb-c2cf2f0958e3 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:51 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7 Nov 04 19:06:51 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:51 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-06f9eb79-1f64-4191-b711-1798a8a778de tempest-VolumeDependencyTests-753308342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.288s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:51 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-06f9eb79-1f64-4191-b711-1798a8a778de tempest-VolumeDependencyTests-753308342 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:51 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-06f9eb79-1f64-4191-b711-1798a8a778de tempest-VolumeDependencyTests-753308342 None] Deleted volume successfully. Nov 04 19:06:51 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-06f9eb79-1f64-4191-b711-1798a8a778de tempest-VolumeDependencyTests-753308342 None] Lock "cinder-90bf7e13-409f-46b7-98c2-b222b8b01919-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:51 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3f28f646-7142-496f-bbeb-c2cf2f0958e3 tempest-ProjectReaderTests-421706438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7" returned: 0 in 0.427s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3f28f646-7142-496f-bbeb-c2cf2f0958e3 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7.971bcdb8-9ee9-468e-852a-04fb5f691dca {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:51 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7.971bcdb8-9ee9-468e-852a-04fb5f691dca Nov 04 19:06:51 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:51 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3f28f646-7142-496f-bbeb-c2cf2f0958e3 tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7.971bcdb8-9ee9-468e-852a-04fb5f691dca" returned: 0 in 0.426s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3f28f646-7142-496f-bbeb-c2cf2f0958e3 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7.971bcdb8-9ee9-468e-852a-04fb5f691dca {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:51 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7.971bcdb8-9ee9-468e-852a-04fb5f691dca Nov 04 19:06:51 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:52 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3f28f646-7142-496f-bbeb-c2cf2f0958e3 tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7.971bcdb8-9ee9-468e-852a-04fb5f691dca" returned: 0 in 0.474s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:52 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3f28f646-7142-496f-bbeb-c2cf2f0958e3 tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-971bcdb8-9ee9-468e-852a-04fb5f691dca" released by "_delete_snapshot" :: held 2.019s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:52 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3f28f646-7142-496f-bbeb-c2cf2f0958e3 tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7" released by "delete_snapshot" :: held 2.060s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:52 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-3f28f646-7142-496f-bbeb-c2cf2f0958e3 tempest-ProjectReaderTests-421706438 None] Created reservations ['535249bd-c916-42e8-bed8-f9b868e0699e', '909f5b01-a1d6-4c90-b2ef-75cb132ebeec', 'c9536208-f57e-420b-a723-d19ae942c0c7', '6c6df86f-3e4b-4453-9cb0-b88ba3808e83'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:52 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-3f28f646-7142-496f-bbeb-c2cf2f0958e3 tempest-ProjectReaderTests-421706438 None] Delete snapshot completed successfully. Nov 04 19:06:52 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3f28f646-7142-496f-bbeb-c2cf2f0958e3 tempest-ProjectReaderTests-421706438 None] Lock "cinder-971bcdb8-9ee9-468e-852a-04fb5f691dca-delete_snapshot" released by "delete_snapshot" :: held 2.258s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:53 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-87904de2-1ef9-46b1-84d1-22d530869b5a tempest-ProjectReaderTests-421706438 None] Acquiring lock "cinder-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:53 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-87904de2-1ef9-46b1-84d1-22d530869b5a tempest-ProjectReaderTests-421706438 None] Lock "cinder-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:53 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-87904de2-1ef9-46b1-84d1-22d530869b5a tempest-ProjectReaderTests-421706438 None] Acquiring lock "cinder-quobyte-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:53 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-87904de2-1ef9-46b1-84d1-22d530869b5a tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7" acquired by "delete_volume" :: waited 0.016s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:53 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[823210d9-8744-46dc-baed-7f97e7790a3e]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-87904de2-1ef9-46b1-84d1-22d530869b5a tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:53 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7 Nov 04 19:06:53 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:54 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-87904de2-1ef9-46b1-84d1-22d530869b5a tempest-ProjectReaderTests-421706438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7" returned: 0 in 0.436s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-87904de2-1ef9-46b1-84d1-22d530869b5a tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:54 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7 Nov 04 19:06:54 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:54 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-87904de2-1ef9-46b1-84d1-22d530869b5a tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7" returned: 0 in 0.298s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:54 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-87904de2-1ef9-46b1-84d1-22d530869b5a tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7" released by "delete_volume" :: held 0.818s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:54 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-87904de2-1ef9-46b1-84d1-22d530869b5a tempest-ProjectReaderTests-421706438 None] Created reservations ['1110bf49-d7a4-4f1e-aa8b-3248811da115', 'a288d1c7-61e2-4028-b9f0-bfdb101c6355', '95e575c7-13f7-47bb-ac81-68d94db7efc5', '2c82f32e-230d-4bf8-aa74-fec2f57184bb'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-87904de2-1ef9-46b1-84d1-22d530869b5a tempest-ProjectReaderTests-421706438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-87904de2-1ef9-46b1-84d1-22d530869b5a tempest-ProjectReaderTests-421706438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:54 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-87904de2-1ef9-46b1-84d1-22d530869b5a tempest-ProjectReaderTests-421706438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:54 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-87904de2-1ef9-46b1-84d1-22d530869b5a tempest-ProjectReaderTests-421706438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-87904de2-1ef9-46b1-84d1-22d530869b5a tempest-ProjectReaderTests-421706438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-87904de2-1ef9-46b1-84d1-22d530869b5a tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:54 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:06:54 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:54 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-87904de2-1ef9-46b1-84d1-22d530869b5a tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.323s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:54 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-87904de2-1ef9-46b1-84d1-22d530869b5a tempest-ProjectReaderTests-421706438 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:54 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-87904de2-1ef9-46b1-84d1-22d530869b5a tempest-ProjectReaderTests-421706438 None] Deleted volume successfully. Nov 04 19:06:55 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-87904de2-1ef9-46b1-84d1-22d530869b5a tempest-ProjectReaderTests-421706438 None] Lock "cinder-b71ef851-03c5-4ecb-83ab-2c10ebc29dd7-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:55 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Flow 'volume_create_manager' (5826a8c1-d543-4db6-90ad-67dab6df1cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a9f8f7-6cce-45a8-8cbf-419f23972f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a9f8f7-6cce-45a8-8cbf-419f23972f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1560891638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16df5f25-6b5a-4730-9763-3567130314fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e06bd473564743b698ac5523d08c3fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:55Z,use_quota=True,user_id='6fc22b0379ef4e65ae31fdfa79981aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab3354f2-02ed-4504-a582-873c09592387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab3354f2-02ed-4504-a582-873c09592387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (539da848-ea8c-4f0c-b665-d3fa8803d487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (539da848-ea8c-4f0c-b665-d3fa8803d487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16df5f25-6b5a-4730-9763-3567130314fb', 'volume_name': 'volume-16df5f25-6b5a-4730-9763-3567130314fb', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c45ec4a-3949-4d9c-bae2-984e1b53c687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c45ec4a-3949-4d9c-bae2-984e1b53c687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:55 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a5557c6-4e98-40cc-afbb-7efe27df5b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:55 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Volume 16df5f25-6b5a-4730-9763-3567130314fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16df5f25-6b5a-4730-9763-3567130314fb', 'volume_size': 1} Nov 04 19:06:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:55 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1560891638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16df5f25-6b5a-4730-9763-3567130314fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e06bd473564743b698ac5523d08c3fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:55Z,use_quota=True,user_id='6fc22b0379ef4e65ae31fdfa79981aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:55 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Creating volume 16df5f25-6b5a-4730-9763-3567130314fb {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:55 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:55 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:55 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:55 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:06:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:55 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb 1073741824 Nov 04 19:06:55 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:56 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb 1073741824" returned: 0 in 0.626s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:56 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb Nov 04 19:06:56 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:56 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb" returned: 0 in 0.301s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a5557c6-4e98-40cc-afbb-7efe27df5b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16df5f25-6b5a-4730-9763-3567130314fb', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6eaa8fc-dc7b-41a4-ad10-103ee4d275f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:56 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Volume volume-16df5f25-6b5a-4730-9763-3567130314fb (16df5f25-6b5a-4730-9763-3567130314fb): created successfully Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6eaa8fc-dc7b-41a4-ad10-103ee4d275f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Flow 'volume_create_manager' (5826a8c1-d543-4db6-90ad-67dab6df1cc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Flow 'volume_create_manager' (ddecce57-1897-4f9b-9bb4-64118e90a605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b6889f-b911-4233-9b26-7d7eb24d113b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:56 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-ebcbc74b-0a03-4a0c-ae1b-dda2d724f956 tempest-ProjectReaderTests-421706438 None] Created volume successfully. Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b6889f-b911-4233-9b26-7d7eb24d113b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-752981633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0756a8cc-bba0-4769-a558-e5d9f09e17be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c43fcd4a2cd4b7ba59d5957cbe4a159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:57Z,use_quota=True,user_id='e79f649a4d424d6ba9872e9c58307a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a43782-8c9a-4312-abbd-2f83d4bc5de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a43782-8c9a-4312-abbd-2f83d4bc5de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf31de6-6bf3-4925-ab83-1b7ea3ab50c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf31de6-6bf3-4925-ab83-1b7ea3ab50c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0756a8cc-bba0-4769-a558-e5d9f09e17be', 'volume_name': 'volume-0756a8cc-bba0-4769-a558-e5d9f09e17be', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f6953fa-578f-425c-ae5c-4cc1976140a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f6953fa-578f-425c-ae5c-4cc1976140a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f3ec20-6ad8-4461-bffd-006d0824e888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:56 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Volume 0756a8cc-bba0-4769-a558-e5d9f09e17be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0756a8cc-bba0-4769-a558-e5d9f09e17be', 'volume_size': 1} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-752981633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0756a8cc-bba0-4769-a558-e5d9f09e17be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c43fcd4a2cd4b7ba59d5957cbe4a159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:57Z,use_quota=True,user_id='e79f649a4d424d6ba9872e9c58307a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Creating volume 0756a8cc-bba0-4769-a558-e5d9f09e17be {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:56 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-0756a8cc-bba0-4769-a558-e5d9f09e17be 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:56 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-0756a8cc-bba0-4769-a558-e5d9f09e17be 1073741824 Nov 04 19:06:56 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Flow 'volume_create_manager' (be461b79-063f-4878-b06f-a32d1275a4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0089a2ee-65d9-43b4-bc64-102e8fd81313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0089a2ee-65d9-43b4-bc64-102e8fd81313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b539f339-92ee-4530-b12e-abc8d2469509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d8e4e74c05484e921afe1014e7ae54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:57Z,use_quota=True,user_id='97c363e82d034c2fa10abf3a5c4a1630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cde7cea-7287-4b75-b75e-7e4fd6a4ec4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cde7cea-7287-4b75-b75e-7e4fd6a4ec4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45dcb0c7-560a-4559-9379-765c102d0662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:56 devstack cinder-volume[87119]: DEBUG cinder.image.glance [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Creating Keystone auth plugin from conf {{(pid=87119) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 19:06:57 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-0756a8cc-bba0-4769-a558-e5d9f09e17be 1073741824" returned: 0 in 0.582s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-0756a8cc-bba0-4769-a558-e5d9f09e17be {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45dcb0c7-560a-4559-9379-765c102d0662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b539f339-92ee-4530-b12e-abc8d2469509', 'volume_name': 'volume-b539f339-92ee-4530-b12e-abc8d2469509', 'volume_size': 1, 'image_id': '64c06ba8-a713-4e0c-ae79-f465b82df590', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64c06ba8-a713-4e0c-ae79-f465b82df590', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '037aa38979883ec6c22a54d587fe4c3e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34d8e4e74c05484e921afe1014e7ae54', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e0930f170387eabe49026fc3ca3e76c38ee73859c27d56cce96f6b3e766fbc0de0779db2a7fa7146982475e41da3dbb0332213b2a2f094ede9b07cf35a3063e4', 'id': '64c06ba8-a713-4e0c-ae79-f465b82df590', 'created_at': datetime.datetime(2026, 11, 4, 18, 6, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 6, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64c06ba8-a713-4e0c-ae79-f465b82df590/file', 'properties': {}}, 'image_service': }' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef37ec8-d542-44da-a2d5-15a9ee638bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef37ec8-d542-44da-a2d5-15a9ee638bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:57 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-0756a8cc-bba0-4769-a558-e5d9f09e17be Nov 04 19:06:57 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ff3976-5ba9-4f3b-9eb4-49f944606b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:57 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Volume b539f339-92ee-4530-b12e-abc8d2469509: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b539f339-92ee-4530-b12e-abc8d2469509', 'volume_size': 1, 'image_id': '64c06ba8-a713-4e0c-ae79-f465b82df590', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64c06ba8-a713-4e0c-ae79-f465b82df590', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '037aa38979883ec6c22a54d587fe4c3e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34d8e4e74c05484e921afe1014e7ae54', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e0930f170387eabe49026fc3ca3e76c38ee73859c27d56cce96f6b3e766fbc0de0779db2a7fa7146982475e41da3dbb0332213b2a2f094ede9b07cf35a3063e4', 'id': '64c06ba8-a713-4e0c-ae79-f465b82df590', 'created_at': datetime.datetime(2026, 11, 4, 18, 6, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 6, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64c06ba8-a713-4e0c-ae79-f465b82df590/file', 'properties': {}}, 'image_service': } Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Trying to clone b539f339-92ee-4530-b12e-abc8d2469509 from image 64c06ba8-a713-4e0c-ae79-f465b82df590 at location (None, [{'url': 'file:///opt/stack/data/glance/images/64c06ba8-a713-4e0c-ae79-f465b82df590', 'metadata': {}}]). {{(pid=87119) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Flow 'volume_create_manager' (7b5608b8-27dd-494b-bc3a-442a6028c66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5f0e9f-b692-4896-a538-cd7942e005fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_64c06ba8-a713-4e0c-ae79-f465b82df590_njyd2fyadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 19:06:57 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Image download 0.00 MB at 0.00 MB/s Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5f0e9f-b692-4896-a538-cd7942e005fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-295040101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97350a76-c897-468d-87d5-acd744723bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c43fcd4a2cd4b7ba59d5957cbe4a159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:57Z,use_quota=True,user_id='e79f649a4d424d6ba9872e9c58307a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e37b5142-44b8-43b9-aaab-84b0f26e36ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e37b5142-44b8-43b9-aaab-84b0f26e36ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c38dfa-1978-4f74-b518-9b5648bcf30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c38dfa-1978-4f74-b518-9b5648bcf30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97350a76-c897-468d-87d5-acd744723bf6', 'volume_name': 'volume-97350a76-c897-468d-87d5-acd744723bf6', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d066115-89d8-4c21-a110-61d869bcc32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d066115-89d8-4c21-a110-61d869bcc32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa44fb8-4014-4071-b30e-133a1f7486d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:57 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Volume 97350a76-c897-468d-87d5-acd744723bf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97350a76-c897-468d-87d5-acd744723bf6', 'volume_size': 1} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Flow 'volume_create_manager' (5c8c7a7b-dc41-4814-8762-f63d8fe3a2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5654e7d-6716-45c1-922c-ada9fc1ce9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83f274d-2d1d-40de-bc1e-dc0618304d05]: (4, 'raw') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64c06ba8-a713-4e0c-ae79-f465b82df590_njyd2fyadevstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5654e7d-6716-45c1-922c-ada9fc1ce9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83403f70-4d14-4d33-bd8f-e86cb98ee644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90102df7523a4702b8b3c232add9d38c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:58Z,use_quota=True,user_id='d5101cf6bc014e4aa439dfb7c52f043f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e87eb49a-1f0e-42f6-808b-7add4879728b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e87eb49a-1f0e-42f6-808b-7add4879728b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0afee2a1-55f0-43ae-b2ae-7fa41fc10583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0afee2a1-55f0-43ae-b2ae-7fa41fc10583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83403f70-4d14-4d33-bd8f-e86cb98ee644', 'volume_name': 'volume-83403f70-4d14-4d33-bd8f-e86cb98ee644', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:57 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde438e0-87d8-4424-b71a-bd65990abcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde438e0-87d8-4424-b71a-bd65990abcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf58a5d-c845-4da4-97f5-1d7c05f3d4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:57 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Volume 83403f70-4d14-4d33-bd8f-e86cb98ee644: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83403f70-4d14-4d33-bd8f-e86cb98ee644', 'volume_size': 1} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Flow 'volume_create_manager' (d0cf852b-dc73-444f-86e5-5b364886bdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (933e10b7-6e42-4e97-a9b2-e5cc6f2abb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-0756a8cc-bba0-4769-a558-e5d9f09e17be" returned: 0 in 0.526s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.201s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-295040101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97350a76-c897-468d-87d5-acd744723bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c43fcd4a2cd4b7ba59d5957cbe4a159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:57Z,use_quota=True,user_id='e79f649a4d424d6ba9872e9c58307a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Creating volume 97350a76-c897-468d-87d5-acd744723bf6 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:57 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-97350a76-c897-468d-87d5-acd744723bf6 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:57 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f3ec20-6ad8-4461-bffd-006d0824e888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0756a8cc-bba0-4769-a558-e5d9f09e17be', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2cc9b47-99fe-4c26-974a-682fd1b136fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:58 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64c06ba8-a713-4e0c-ae79-f465b82df590_njyd2fyadevstack@QuobyteHD Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (933e10b7-6e42-4e97-a9b2-e5cc6f2abb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1789264637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3ee0b7b-205f-4cb3-b76d-c6c016f346fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c43fcd4a2cd4b7ba59d5957cbe4a159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:58Z,use_quota=True,user_id='e79f649a4d424d6ba9872e9c58307a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e74dbb-253e-4021-8281-89d49ce8f72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:58 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e74dbb-253e-4021-8281-89d49ce8f72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48856b19-616f-4492-8117-175b78c5c18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:58 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-97350a76-c897-468d-87d5-acd744723bf6 1073741824 Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48856b19-616f-4492-8117-175b78c5c18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3ee0b7b-205f-4cb3-b76d-c6c016f346fd', 'volume_name': 'volume-f3ee0b7b-205f-4cb3-b76d-c6c016f346fd', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:58 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f12e2d1-e27a-4580-9956-a61c78463b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f12e2d1-e27a-4580-9956-a61c78463b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e73230a-31a2-476b-9227-bf763ba9d59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:58 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Volume f3ee0b7b-205f-4cb3-b76d-c6c016f346fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3ee0b7b-205f-4cb3-b76d-c6c016f346fd', 'volume_size': 1} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:58 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Volume volume-0756a8cc-bba0-4769-a558-e5d9f09e17be (0756a8cc-bba0-4769-a558-e5d9f09e17be): created successfully Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2cc9b47-99fe-4c26-974a-682fd1b136fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Flow 'volume_create_manager' (ddecce57-1897-4f9b-9bb4-64118e90a605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-42df1318-f109-4964-9f8b-ac1be2630536 tempest-ProjectReaderTests-421706438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:58 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-a35ede05-e0a4-4cb4-9483-940e3e94a314 tempest-CreateVolumesFromImageTest-120535797 None] Created volume successfully. Nov 04 19:06:58 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64c06ba8-a713-4e0c-ae79-f465b82df590_njyd2fyadevstack@QuobyteHD" returned: 0 in 0.556s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64c06ba8-a713-4e0c-ae79-f465b82df590_njyd2fyadevstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:58 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64c06ba8-a713-4e0c-ae79-f465b82df590_njyd2fyadevstack@QuobyteHD Nov 04 19:06:58 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Flow 'volume_create_manager' (31c286e2-c0e5-4855-8867-56ea2ff3f572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b7d8ef-0d9d-4206-bb67-41b6645f01e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b7d8ef-0d9d-4206-bb67-41b6645f01e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-353047897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6828ffc6-4aca-4a7d-a399-7b3622301b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c43fcd4a2cd4b7ba59d5957cbe4a159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:58Z,use_quota=True,user_id='e79f649a4d424d6ba9872e9c58307a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c93a58-1bd5-45a8-9ff3-9adc6f85bd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:58 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c93a58-1bd5-45a8-9ff3-9adc6f85bd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6adeca9f-c96e-4707-a339-2ddab28342d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6adeca9f-c96e-4707-a339-2ddab28342d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6828ffc6-4aca-4a7d-a399-7b3622301b97', 'volume_name': 'volume-6828ffc6-4aca-4a7d-a399-7b3622301b97', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2047355d-dcad-46ca-a319-ae83be4e6208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2047355d-dcad-46ca-a319-ae83be4e6208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03bbeede-e8fd-4218-ba87-37e283a59e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:58 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Volume 6828ffc6-4aca-4a7d-a399-7b3622301b97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6828ffc6-4aca-4a7d-a399-7b3622301b97', 'volume_size': 1} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-97350a76-c897-468d-87d5-acd744723bf6 1073741824" returned: 0 in 0.666s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-97350a76-c897-468d-87d5-acd744723bf6 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:58 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-97350a76-c897-468d-87d5-acd744723bf6 Nov 04 19:06:58 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:58 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64c06ba8-a713-4e0c-ae79-f465b82df590_njyd2fyadevstack@QuobyteHD" returned: 1 in 0.434s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64c06ba8-a713-4e0c-ae79-f465b82df590_njyd2fyadevstack@QuobyteHD' failed. Not Retrying. {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Temporary image 64c06ba8-a713-4e0c-ae79-f465b82df590 is fetched for user 97c363e82d034c2fa10abf3a5c4a1630. {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0efe3af-2336-488a-8d9e-829d695537d7]: (4, 'raw') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64c06ba8-a713-4e0c-ae79-f465b82df590_njyd2fyadevstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:58 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-97350a76-c897-468d-87d5-acd744723bf6" returned: 0 in 0.301s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.074s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83403f70-4d14-4d33-bd8f-e86cb98ee644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90102df7523a4702b8b3c232add9d38c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:58Z,use_quota=True,user_id='d5101cf6bc014e4aa439dfb7c52f043f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Creating volume 83403f70-4d14-4d33-bd8f-e86cb98ee644 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:58 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:06:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-83403f70-4d14-4d33-bd8f-e86cb98ee644 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa44fb8-4014-4071-b30e-133a1f7486d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97350a76-c897-468d-87d5-acd744723bf6', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7776165b-1e11-45aa-afa6-8dc13d544ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:59 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-83403f70-4d14-4d33-bd8f-e86cb98ee644 1073741824 Nov 04 19:06:59 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:59 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Volume volume-97350a76-c897-468d-87d5-acd744723bf6 (97350a76-c897-468d-87d5-acd744723bf6): created successfully Nov 04 19:06:59 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64c06ba8-a713-4e0c-ae79-f465b82df590_njyd2fyadevstack@QuobyteHD Nov 04 19:06:59 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7776165b-1e11-45aa-afa6-8dc13d544ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Flow 'volume_create_manager' (7b5608b8-27dd-494b-bc3a-442a6028c66b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Flow 'volume_create_manager' (b76729d9-177b-4924-91c1-3b03e57480c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c8ce3c-da8c-4c0b-a8e6-20b7ab8ee66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:59 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-69088ab3-89de-4755-81e8-e5d4c7eb214f tempest-CreateVolumesFromImageTest-120535797 None] Created volume successfully. Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c8ce3c-da8c-4c0b-a8e6-20b7ab8ee66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-408204455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e66e5a65-86fb-41ae-83c4-89e9e7edee61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c43fcd4a2cd4b7ba59d5957cbe4a159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:59Z,use_quota=True,user_id='e79f649a4d424d6ba9872e9c58307a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f30341-1542-410c-bbed-733510f03748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f30341-1542-410c-bbed-733510f03748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a02f62be-2891-4109-9f0c-68c7942da1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a02f62be-2891-4109-9f0c-68c7942da1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e66e5a65-86fb-41ae-83c4-89e9e7edee61', 'volume_name': 'volume-e66e5a65-86fb-41ae-83c4-89e9e7edee61', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ad7b93-a8b9-4a59-b142-d00dc70cb09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ad7b93-a8b9-4a59-b142-d00dc70cb09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6aa979-5d95-4000-8301-004045e8965c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:59 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Volume e66e5a65-86fb-41ae-83c4-89e9e7edee61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e66e5a65-86fb-41ae-83c4-89e9e7edee61', 'volume_size': 1} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:59 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64c06ba8-a713-4e0c-ae79-f465b82df590_njyd2fyadevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64c06ba8-a713-4e0c-ae79-f465b82df590_njyd2fyadevstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:59 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64c06ba8-a713-4e0c-ae79-f465b82df590_njyd2fyadevstack@QuobyteHD Nov 04 19:06:59 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:59 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-83403f70-4d14-4d33-bd8f-e86cb98ee644 1073741824" returned: 0 in 0.505s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-83403f70-4d14-4d33-bd8f-e86cb98ee644 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:59 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-83403f70-4d14-4d33-bd8f-e86cb98ee644 Nov 04 19:06:59 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:59 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64c06ba8-a713-4e0c-ae79-f465b82df590_njyd2fyadevstack@QuobyteHD" returned: 1 in 0.367s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64c06ba8-a713-4e0c-ae79-f465b82df590_njyd2fyadevstack@QuobyteHD' failed. Not Retrying. {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:59 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-83403f70-4d14-4d33-bd8f-e86cb98ee644" returned: 0 in 0.247s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.724s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1789264637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3ee0b7b-205f-4cb3-b76d-c6c016f346fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c43fcd4a2cd4b7ba59d5957cbe4a159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:58Z,use_quota=True,user_id='e79f649a4d424d6ba9872e9c58307a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Creating volume f3ee0b7b-205f-4cb3-b76d-c6c016f346fd {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:59 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f3ee0b7b-205f-4cb3-b76d-c6c016f346fd 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf58a5d-c845-4da4-97f5-1d7c05f3d4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83403f70-4d14-4d33-bd8f-e86cb98ee644', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:59 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f3ee0b7b-205f-4cb3-b76d-c6c016f346fd 1073741824 Nov 04 19:06:59 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67d93244-005c-4520-b376-c948b60ee60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:59 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Volume volume-83403f70-4d14-4d33-bd8f-e86cb98ee644 (83403f70-4d14-4d33-bd8f-e86cb98ee644): created successfully Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67d93244-005c-4520-b376-c948b60ee60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:59 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Flow 'volume_create_manager' (5c8c7a7b-dc41-4814-8762-f63d8fe3a2f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:59 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e487d8e5-1a85-4015-8596-bb680f086c0f tempest-CinderUnicodeTest-1089747710 None] Created volume successfully. Nov 04 19:07:00 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f3ee0b7b-205f-4cb3-b76d-c6c016f346fd 1073741824" returned: 0 in 0.428s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f3ee0b7b-205f-4cb3-b76d-c6c016f346fd {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:00 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f3ee0b7b-205f-4cb3-b76d-c6c016f346fd Nov 04 19:07:00 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:00 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f3ee0b7b-205f-4cb3-b76d-c6c016f346fd" returned: 0 in 0.255s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:00 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-42df1318-f109-4964-9f8b-ac1be2630536 tempest-ProjectReaderTests-421706438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.407s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:00 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e73230a-31a2-476b-9227-bf763ba9d59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3ee0b7b-205f-4cb3-b76d-c6c016f346fd', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:00 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337432a4-09ed-470b-bb1b-2fe58f84f888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:00 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-42df1318-f109-4964-9f8b-ac1be2630536 tempest-ProjectReaderTests-421706438 None] Creating offline snapshot a0619c54-f482-4619-a090-c57c00f3ca1d of volume 16df5f25-6b5a-4730-9763-3567130314fb {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:07:00 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Volume volume-f3ee0b7b-205f-4cb3-b76d-c6c016f346fd (f3ee0b7b-205f-4cb3-b76d-c6c016f346fd): created successfully Nov 04 19:07:00 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337432a4-09ed-470b-bb1b-2fe58f84f888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:00 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Flow 'volume_create_manager' (d0cf852b-dc73-444f-86e5-5b364886bdc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:00 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[241f584b-0ea1-4a23-bafe-c58885c9da23]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-42df1318-f109-4964-9f8b-ac1be2630536 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:00 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-48c3ce97-1ce3-4366-ab23-9d789688ba59 tempest-CreateVolumesFromImageTest-120535797 None] Created volume successfully. Nov 04 19:07:00 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb Nov 04 19:07:00 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:00 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-42df1318-f109-4964-9f8b-ac1be2630536 tempest-ProjectReaderTests-421706438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb" returned: 0 in 0.385s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-42df1318-f109-4964-9f8b-ac1be2630536 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb.a0619c54-f482-4619-a090-c57c00f3ca1d 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:00 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb.a0619c54-f482-4619-a090-c57c00f3ca1d 1G Nov 04 19:07:00 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:01 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Flow 'volume_create_manager' (61fd69b6-ee68-4e8d-98f8-5fe56bd8fd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f50a002-430f-4c63-88d5-62a251b30594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f50a002-430f-4c63-88d5-62a251b30594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-567641928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738888f7-8bdc-41e4-9427-b85267572fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90102df7523a4702b8b3c232add9d38c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:01Z,use_quota=True,user_id='d5101cf6bc014e4aa439dfb7c52f043f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb9e6f2-7930-490c-b652-6a440119564a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb9e6f2-7930-490c-b652-6a440119564a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9cefe42-c464-424f-bc32-163734e08dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9cefe42-c464-424f-bc32-163734e08dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '738888f7-8bdc-41e4-9427-b85267572fe6', 'volume_name': 'volume-738888f7-8bdc-41e4-9427-b85267572fe6', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e725426-4034-45d1-8a96-44b53047aa11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e725426-4034-45d1-8a96-44b53047aa11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f793794-dda9-4c9f-b011-4fe180f28f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:01 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Volume 738888f7-8bdc-41e4-9427-b85267572fe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-738888f7-8bdc-41e4-9427-b85267572fe6', 'volume_size': 1} Nov 04 19:07:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:01 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-42df1318-f109-4964-9f8b-ac1be2630536 tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb.a0619c54-f482-4619-a090-c57c00f3ca1d 1G" returned: 0 in 0.407s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-42df1318-f109-4964-9f8b-ac1be2630536 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16df5f25-6b5a-4730-9763-3567130314fb -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb.a0619c54-f482-4619-a090-c57c00f3ca1d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:01 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16df5f25-6b5a-4730-9763-3567130314fb -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb.a0619c54-f482-4619-a090-c57c00f3ca1d Nov 04 19:07:01 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:01 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-42df1318-f109-4964-9f8b-ac1be2630536 tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16df5f25-6b5a-4730-9763-3567130314fb -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb.a0619c54-f482-4619-a090-c57c00f3ca1d" returned: 0 in 0.276s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:01 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-42df1318-f109-4964-9f8b-ac1be2630536 tempest-ProjectReaderTests-421706438 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb.a0619c54-f482-4619-a090-c57c00f3ca1d is being set with open permissions: ugo+rw Nov 04 19:07:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-42df1318-f109-4964-9f8b-ac1be2630536 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb.a0619c54-f482-4619-a090-c57c00f3ca1d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:01 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb.a0619c54-f482-4619-a090-c57c00f3ca1d Nov 04 19:07:01 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:01 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-42df1318-f109-4964-9f8b-ac1be2630536 tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb.a0619c54-f482-4619-a090-c57c00f3ca1d" returned: 0 in 0.239s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-42df1318-f109-4964-9f8b-ac1be2630536 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:01 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb.info Nov 04 19:07:01 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:02 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-42df1318-f109-4964-9f8b-ac1be2630536 tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb.info" returned: 0 in 0.243s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:02 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-42df1318-f109-4964-9f8b-ac1be2630536 tempest-ProjectReaderTests-421706438 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb.info is being set with open permissions: ugo+rw Nov 04 19:07:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-42df1318-f109-4964-9f8b-ac1be2630536 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:02 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb.info Nov 04 19:07:02 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:02 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-42df1318-f109-4964-9f8b-ac1be2630536 tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb.info" returned: 0 in 0.259s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-42df1318-f109-4964-9f8b-ac1be2630536 tempest-ProjectReaderTests-421706438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.923s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.808s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-353047897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6828ffc6-4aca-4a7d-a399-7b3622301b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c43fcd4a2cd4b7ba59d5957cbe4a159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:58Z,use_quota=True,user_id='e79f649a4d424d6ba9872e9c58307a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Creating volume 6828ffc6-4aca-4a7d-a399-7b3622301b97 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:02 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:07:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6828ffc6-4aca-4a7d-a399-7b3622301b97 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:02 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6828ffc6-4aca-4a7d-a399-7b3622301b97 1073741824 Nov 04 19:07:02 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:02 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-42df1318-f109-4964-9f8b-ac1be2630536 tempest-ProjectReaderTests-421706438 None] Create snapshot completed successfully Nov 04 19:07:02 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6828ffc6-4aca-4a7d-a399-7b3622301b97 1073741824" returned: 0 in 0.429s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6828ffc6-4aca-4a7d-a399-7b3622301b97 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:02 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6828ffc6-4aca-4a7d-a399-7b3622301b97 Nov 04 19:07:02 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:03 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6828ffc6-4aca-4a7d-a399-7b3622301b97" returned: 0 in 0.247s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.016s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-408204455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e66e5a65-86fb-41ae-83c4-89e9e7edee61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c43fcd4a2cd4b7ba59d5957cbe4a159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:59Z,use_quota=True,user_id='e79f649a4d424d6ba9872e9c58307a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Creating volume e66e5a65-86fb-41ae-83c4-89e9e7edee61 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:03 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e66e5a65-86fb-41ae-83c4-89e9e7edee61 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03bbeede-e8fd-4218-ba87-37e283a59e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6828ffc6-4aca-4a7d-a399-7b3622301b97', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:03 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e66e5a65-86fb-41ae-83c4-89e9e7edee61 1073741824 Nov 04 19:07:03 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0821cd5d-5dc2-4bfd-a675-e385bdbe871a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:03 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Volume volume-6828ffc6-4aca-4a7d-a399-7b3622301b97 (6828ffc6-4aca-4a7d-a399-7b3622301b97): created successfully Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0821cd5d-5dc2-4bfd-a675-e385bdbe871a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Flow 'volume_create_manager' (31c286e2-c0e5-4855-8867-56ea2ff3f572) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:03 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-6a7eb8af-6576-48ad-8e99-4529be2b58dc tempest-CreateVolumesFromImageTest-120535797 None] Created volume successfully. Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-afd81d98-baf7-415a-9501-6a78597cde2a tempest-ProjectReaderTests-421706438 None] Acquiring lock "cinder-a0619c54-f482-4619-a090-c57c00f3ca1d-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-afd81d98-baf7-415a-9501-6a78597cde2a tempest-ProjectReaderTests-421706438 None] Lock "cinder-a0619c54-f482-4619-a090-c57c00f3ca1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-afd81d98-baf7-415a-9501-6a78597cde2a tempest-ProjectReaderTests-421706438 None] Acquiring lock "cinder-quobyte-16df5f25-6b5a-4730-9763-3567130314fb" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-afd81d98-baf7-415a-9501-6a78597cde2a tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-16df5f25-6b5a-4730-9763-3567130314fb" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-afd81d98-baf7-415a-9501-6a78597cde2a tempest-ProjectReaderTests-421706438 None] Acquiring lock "cinder-quobyte-a0619c54-f482-4619-a090-c57c00f3ca1d" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-afd81d98-baf7-415a-9501-6a78597cde2a tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-a0619c54-f482-4619-a090-c57c00f3ca1d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-afd81d98-baf7-415a-9501-6a78597cde2a tempest-ProjectReaderTests-421706438 None] Deleting offline snapshot a0619c54-f482-4619-a090-c57c00f3ca1d of volume 16df5f25-6b5a-4730-9763-3567130314fb {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-afd81d98-baf7-415a-9501-6a78597cde2a tempest-ProjectReaderTests-421706438 None] snapshot_file for this snap is: volume-16df5f25-6b5a-4730-9763-3567130314fb.a0619c54-f482-4619-a090-c57c00f3ca1d {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[04321651-05e0-46e1-ba9b-ceb9f26ce6ee]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-afd81d98-baf7-415a-9501-6a78597cde2a tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb.a0619c54-f482-4619-a090-c57c00f3ca1d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:03 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb.a0619c54-f482-4619-a090-c57c00f3ca1d Nov 04 19:07:03 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:03 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e66e5a65-86fb-41ae-83c4-89e9e7edee61 1073741824" returned: 0 in 0.477s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e66e5a65-86fb-41ae-83c4-89e9e7edee61 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:03 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e66e5a65-86fb-41ae-83c4-89e9e7edee61 Nov 04 19:07:03 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:03 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-afd81d98-baf7-415a-9501-6a78597cde2a tempest-ProjectReaderTests-421706438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb.a0619c54-f482-4619-a090-c57c00f3ca1d" returned: 0 in 0.400s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-afd81d98-baf7-415a-9501-6a78597cde2a tempest-ProjectReaderTests-421706438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16df5f25-6b5a-4730-9763-3567130314fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bfed0f-fd81-4bc8-9960-5dd1dfcb2bab]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-afd81d98-baf7-415a-9501-6a78597cde2a tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:03 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:03 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb Nov 04 19:07:03 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e66e5a65-86fb-41ae-83c4-89e9e7edee61" returned: 0 in 0.285s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.305s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b539f339-92ee-4530-b12e-abc8d2469509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d8e4e74c05484e921afe1014e7ae54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:57Z,use_quota=True,user_id='97c363e82d034c2fa10abf3a5c4a1630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Creating volume b539f339-92ee-4530-b12e-abc8d2469509 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:03 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:07:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b539f339-92ee-4530-b12e-abc8d2469509 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6aa979-5d95-4000-8301-004045e8965c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e66e5a65-86fb-41ae-83c4-89e9e7edee61', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:04 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b539f339-92ee-4530-b12e-abc8d2469509 1073741824 Nov 04 19:07:04 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19997054-7101-4056-ac3a-d62a9fcca8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:04 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Volume volume-e66e5a65-86fb-41ae-83c4-89e9e7edee61 (e66e5a65-86fb-41ae-83c4-89e9e7edee61): created successfully Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19997054-7101-4056-ac3a-d62a9fcca8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Flow 'volume_create_manager' (b76729d9-177b-4924-91c1-3b03e57480c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:04 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-53ce2f71-13af-4bd4-bb12-d7ee31f5caad tempest-CreateVolumesFromImageTest-120535797 None] Created volume successfully. Nov 04 19:07:04 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-afd81d98-baf7-415a-9501-6a78597cde2a tempest-ProjectReaderTests-421706438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb" returned: 0 in 0.395s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-afd81d98-baf7-415a-9501-6a78597cde2a tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb.a0619c54-f482-4619-a090-c57c00f3ca1d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:04 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb.a0619c54-f482-4619-a090-c57c00f3ca1d Nov 04 19:07:04 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:04 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b539f339-92ee-4530-b12e-abc8d2469509 1073741824" returned: 0 in 0.485s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e485e461-87f4-4dab-9e4b-98a2f8e9423e tempest-CreateVolumesFromImageTest-120535797 None] Acquiring lock "cinder-e66e5a65-86fb-41ae-83c4-89e9e7edee61-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b539f339-92ee-4530-b12e-abc8d2469509 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e485e461-87f4-4dab-9e4b-98a2f8e9423e tempest-CreateVolumesFromImageTest-120535797 None] Lock "cinder-e66e5a65-86fb-41ae-83c4-89e9e7edee61-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:04 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b539f339-92ee-4530-b12e-abc8d2469509 Nov 04 19:07:04 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e485e461-87f4-4dab-9e4b-98a2f8e9423e tempest-CreateVolumesFromImageTest-120535797 None] Acquiring lock "cinder-quobyte-e66e5a65-86fb-41ae-83c4-89e9e7edee61" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e485e461-87f4-4dab-9e4b-98a2f8e9423e tempest-CreateVolumesFromImageTest-120535797 None] Lock "cinder-quobyte-e66e5a65-86fb-41ae-83c4-89e9e7edee61" acquired by "delete_volume" :: waited 0.016s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[624ffa7e-ba7b-41ee-8fbe-801d3401f3a8]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e485e461-87f4-4dab-9e4b-98a2f8e9423e tempest-CreateVolumesFromImageTest-120535797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e66e5a65-86fb-41ae-83c4-89e9e7edee61 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:04 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-afd81d98-baf7-415a-9501-6a78597cde2a tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb.a0619c54-f482-4619-a090-c57c00f3ca1d" returned: 0 in 0.431s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-afd81d98-baf7-415a-9501-6a78597cde2a tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb.a0619c54-f482-4619-a090-c57c00f3ca1d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:04 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb.a0619c54-f482-4619-a090-c57c00f3ca1d Nov 04 19:07:04 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:04 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e66e5a65-86fb-41ae-83c4-89e9e7edee61 Nov 04 19:07:04 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:04 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b539f339-92ee-4530-b12e-abc8d2469509" returned: 0 in 0.292s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.750s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-567641928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738888f7-8bdc-41e4-9427-b85267572fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90102df7523a4702b8b3c232add9d38c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:01Z,use_quota=True,user_id='d5101cf6bc014e4aa439dfb7c52f043f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Creating volume 738888f7-8bdc-41e4-9427-b85267572fe6 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:04 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:04 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6 1073741824 Nov 04 19:07:04 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Attempting download of 64c06ba8-a713-4e0c-ae79-f465b82df590 ((None, [{'url': 'file:///opt/stack/data/glance/images/64c06ba8-a713-4e0c-ae79-f465b82df590', 'metadata': {}}])) to volume b539f339-92ee-4530-b12e-abc8d2469509. {{(pid=87119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 19:07:04 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-afd81d98-baf7-415a-9501-6a78597cde2a tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb.a0619c54-f482-4619-a090-c57c00f3ca1d" returned: 0 in 0.292s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a91e720-a3ff-4fc9-935a-13ef41dc5eaa]: (4, 'raw') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64c06ba8-a713-4e0c-ae79-f465b82df590_sylyq616 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-afd81d98-baf7-415a-9501-6a78597cde2a tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-a0619c54-f482-4619-a090-c57c00f3ca1d" released by "_delete_snapshot" :: held 1.651s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-afd81d98-baf7-415a-9501-6a78597cde2a tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-16df5f25-6b5a-4730-9763-3567130314fb" released by "delete_snapshot" :: held 1.679s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:05 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e485e461-87f4-4dab-9e4b-98a2f8e9423e tempest-CreateVolumesFromImageTest-120535797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e66e5a65-86fb-41ae-83c4-89e9e7edee61" returned: 0 in 0.442s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e485e461-87f4-4dab-9e4b-98a2f8e9423e tempest-CreateVolumesFromImageTest-120535797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e66e5a65-86fb-41ae-83c4-89e9e7edee61 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:05 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e66e5a65-86fb-41ae-83c4-89e9e7edee61 Nov 04 19:07:05 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:05 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64c06ba8-a713-4e0c-ae79-f465b82df590_sylyq616 Nov 04 19:07:05 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-afd81d98-baf7-415a-9501-6a78597cde2a tempest-ProjectReaderTests-421706438 None] Created reservations ['a75c2294-68ea-403d-94f5-dfc36c5265f3', 'a92a017e-0221-42ca-8b2d-9b1bb62ba6fd', '6b4583b1-8960-4769-886b-11b7fbf2815e', '4cb9eb2f-33e8-481b-a504-e52982571ee5'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:05 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-afd81d98-baf7-415a-9501-6a78597cde2a tempest-ProjectReaderTests-421706438 None] Delete snapshot completed successfully. Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-afd81d98-baf7-415a-9501-6a78597cde2a tempest-ProjectReaderTests-421706438 None] Lock "cinder-a0619c54-f482-4619-a090-c57c00f3ca1d-delete_snapshot" released by "delete_snapshot" :: held 1.900s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:05 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6 1073741824" returned: 0 in 0.549s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:05 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e485e461-87f4-4dab-9e4b-98a2f8e9423e tempest-CreateVolumesFromImageTest-120535797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-e66e5a65-86fb-41ae-83c4-89e9e7edee61" returned: 0 in 0.319s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:05 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64c06ba8-a713-4e0c-ae79-f465b82df590_sylyq616" returned: 0 in 0.428s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64c06ba8-a713-4e0c-ae79-f465b82df590_sylyq616 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e485e461-87f4-4dab-9e4b-98a2f8e9423e tempest-CreateVolumesFromImageTest-120535797 None] Lock "cinder-quobyte-e66e5a65-86fb-41ae-83c4-89e9e7edee61" released by "delete_volume" :: held 0.825s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:05 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6 Nov 04 19:07:05 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-e485e461-87f4-4dab-9e4b-98a2f8e9423e tempest-CreateVolumesFromImageTest-120535797 None] Created reservations ['526938b8-ee0f-4abe-9938-3c3cc4d79f0d', 'da942952-0514-4fb8-b06f-0c7db1169fb6', 'bdf3a0e9-b7cb-49e8-9a94-226a07de991b', 'f68aab3f-b666-4c98-95d0-ca46f90b6874'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-db088ff9-ee1b-4aee-b781-d94fe776ded0 tempest-ProjectReaderTests-421706438 None] Acquiring lock "cinder-16df5f25-6b5a-4730-9763-3567130314fb-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:05 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64c06ba8-a713-4e0c-ae79-f465b82df590_sylyq616 Nov 04 19:07:05 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-db088ff9-ee1b-4aee-b781-d94fe776ded0 tempest-ProjectReaderTests-421706438 None] Lock "cinder-16df5f25-6b5a-4730-9763-3567130314fb-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-db088ff9-ee1b-4aee-b781-d94fe776ded0 tempest-ProjectReaderTests-421706438 None] Acquiring lock "cinder-quobyte-16df5f25-6b5a-4730-9763-3567130314fb" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-db088ff9-ee1b-4aee-b781-d94fe776ded0 tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-16df5f25-6b5a-4730-9763-3567130314fb" acquired by "delete_volume" :: waited 0.030s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e485e461-87f4-4dab-9e4b-98a2f8e9423e tempest-CreateVolumesFromImageTest-120535797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e485e461-87f4-4dab-9e4b-98a2f8e9423e tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e485e461-87f4-4dab-9e4b-98a2f8e9423e tempest-CreateVolumesFromImageTest-120535797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:05 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e485e461-87f4-4dab-9e4b-98a2f8e9423e tempest-CreateVolumesFromImageTest-120535797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e485e461-87f4-4dab-9e4b-98a2f8e9423e tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e485e461-87f4-4dab-9e4b-98a2f8e9423e tempest-CreateVolumesFromImageTest-120535797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[89914e93-3b45-4dce-9d3b-6ccd117dd1ad]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-db088ff9-ee1b-4aee-b781-d94fe776ded0 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6" returned: 0 in 0.361s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:05 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:07:05 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f793794-dda9-4c9f-b011-4fe180f28f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-738888f7-8bdc-41e4-9427-b85267572fe6', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8be858a-b112-40f3-8de9-b588fa88c372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:05 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64c06ba8-a713-4e0c-ae79-f465b82df590_sylyq616" returned: 1 in 0.441s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64c06ba8-a713-4e0c-ae79-f465b82df590_sylyq616' failed. Not Retrying. {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e2185d-8a3d-4ca4-971e-014caa2d8b03]: (4, 'raw') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64c06ba8-a713-4e0c-ae79-f465b82df590_njyd2fyadevstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:05 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Volume volume-738888f7-8bdc-41e4-9427-b85267572fe6 (738888f7-8bdc-41e4-9427-b85267572fe6): created successfully Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8be858a-b112-40f3-8de9-b588fa88c372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:05 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Flow 'volume_create_manager' (61fd69b6-ee68-4e8d-98f8-5fe56bd8fd5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:05 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-7c11fb0d-342b-4618-8c3c-003b10c67fb8 tempest-CinderUnicodeTest-1089747710 None] Created volume successfully. Nov 04 19:07:05 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb Nov 04 19:07:05 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:06 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64c06ba8-a713-4e0c-ae79-f465b82df590_njyd2fyadevstack@QuobyteHD Nov 04 19:07:06 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:06 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e485e461-87f4-4dab-9e4b-98a2f8e9423e tempest-CreateVolumesFromImageTest-120535797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.276s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-e485e461-87f4-4dab-9e4b-98a2f8e9423e tempest-CreateVolumesFromImageTest-120535797 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:06 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e485e461-87f4-4dab-9e4b-98a2f8e9423e tempest-CreateVolumesFromImageTest-120535797 None] Deleted volume successfully. Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e485e461-87f4-4dab-9e4b-98a2f8e9423e tempest-CreateVolumesFromImageTest-120535797 None] Lock "cinder-e66e5a65-86fb-41ae-83c4-89e9e7edee61-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:06 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-db088ff9-ee1b-4aee-b781-d94fe776ded0 tempest-ProjectReaderTests-421706438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb" returned: 0 in 0.467s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-db088ff9-ee1b-4aee-b781-d94fe776ded0 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:06 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64c06ba8-a713-4e0c-ae79-f465b82df590_njyd2fyadevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64c06ba8-a713-4e0c-ae79-f465b82df590_njyd2fyadevstack@QuobyteHD {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:06 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb Nov 04 19:07:06 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:06 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64c06ba8-a713-4e0c-ae79-f465b82df590_njyd2fyadevstack@QuobyteHD Nov 04 19:07:06 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:06 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-db088ff9-ee1b-4aee-b781-d94fe776ded0 tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-16df5f25-6b5a-4730-9763-3567130314fb" returned: 0 in 0.288s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-db088ff9-ee1b-4aee-b781-d94fe776ded0 tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-16df5f25-6b5a-4730-9763-3567130314fb" released by "delete_volume" :: held 0.848s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1e90d3c8-7669-4bad-88e2-feea53eba771 tempest-CinderUnicodeTest-1089747710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1e90d3c8-7669-4bad-88e2-feea53eba771 tempest-CinderUnicodeTest-1089747710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-1e90d3c8-7669-4bad-88e2-feea53eba771 tempest-CinderUnicodeTest-1089747710 None] Creating offline snapshot d9813158-61db-42ac-9f29-6ff440d2cf49 of volume 738888f7-8bdc-41e4-9427-b85267572fe6 {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-db088ff9-ee1b-4aee-b781-d94fe776ded0 tempest-ProjectReaderTests-421706438 None] Created reservations ['d91d6c4c-6329-46cc-aba5-3f94e62c0ee9', 'bbdaa51a-c654-461c-ab3d-b43dfd70365d', '6a0803da-1845-400b-8ab8-f8f46beb4efb', '1140dba6-221d-454b-a91e-b2f2f2d9154b'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:06 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f81690-8aea-4312-bbc8-ff0baccbb1e0]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1e90d3c8-7669-4bad-88e2-feea53eba771 tempest-CinderUnicodeTest-1089747710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64c06ba8-a713-4e0c-ae79-f465b82df590_njyd2fyadevstack@QuobyteHD" returned: 1 in 0.421s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64c06ba8-a713-4e0c-ae79-f465b82df590_njyd2fyadevstack@QuobyteHD' failed. Not Retrying. {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] 64c06ba8-a713-4e0c-ae79-f465b82df590 was raw, converting to qcow2 {{(pid=87119) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_64c06ba8-a713-4e0c-ae79-f465b82df590_njyd2fyadevstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b539f339-92ee-4530-b12e-abc8d2469509 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:06 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_64c06ba8-a713-4e0c-ae79-f465b82df590_njyd2fyadevstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b539f339-92ee-4530-b12e-abc8d2469509 Nov 04 19:07:06 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d8beca5e-9d53-4f36-897c-b8e29f9d0ccb tempest-CreateVolumesFromImageTest-120535797 None] Acquiring lock "cinder-6828ffc6-4aca-4a7d-a399-7b3622301b97-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d8beca5e-9d53-4f36-897c-b8e29f9d0ccb tempest-CreateVolumesFromImageTest-120535797 None] Lock "cinder-6828ffc6-4aca-4a7d-a399-7b3622301b97-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-db088ff9-ee1b-4aee-b781-d94fe776ded0 tempest-ProjectReaderTests-421706438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-db088ff9-ee1b-4aee-b781-d94fe776ded0 tempest-ProjectReaderTests-421706438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-db088ff9-ee1b-4aee-b781-d94fe776ded0 tempest-ProjectReaderTests-421706438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-db088ff9-ee1b-4aee-b781-d94fe776ded0 tempest-ProjectReaderTests-421706438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-db088ff9-ee1b-4aee-b781-d94fe776ded0 tempest-ProjectReaderTests-421706438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-db088ff9-ee1b-4aee-b781-d94fe776ded0 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:06 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6 Nov 04 19:07:06 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:06 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:07:06 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d8beca5e-9d53-4f36-897c-b8e29f9d0ccb tempest-CreateVolumesFromImageTest-120535797 None] Acquiring lock "cinder-quobyte-6828ffc6-4aca-4a7d-a399-7b3622301b97" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d8beca5e-9d53-4f36-897c-b8e29f9d0ccb tempest-CreateVolumesFromImageTest-120535797 None] Lock "cinder-quobyte-6828ffc6-4aca-4a7d-a399-7b3622301b97" acquired by "delete_volume" :: waited 0.024s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:07 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea7fbea-15eb-44ab-b986-032a5f0b1715]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d8beca5e-9d53-4f36-897c-b8e29f9d0ccb tempest-CreateVolumesFromImageTest-120535797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6828ffc6-4aca-4a7d-a399-7b3622301b97 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:07 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6828ffc6-4aca-4a7d-a399-7b3622301b97 Nov 04 19:07:07 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:07 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-db088ff9-ee1b-4aee-b781-d94fe776ded0 tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.287s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:07 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-db088ff9-ee1b-4aee-b781-d94fe776ded0 tempest-ProjectReaderTests-421706438 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:07 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-db088ff9-ee1b-4aee-b781-d94fe776ded0 tempest-ProjectReaderTests-421706438 None] Deleted volume successfully. Nov 04 19:07:07 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1e90d3c8-7669-4bad-88e2-feea53eba771 tempest-CinderUnicodeTest-1089747710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6" returned: 0 in 0.515s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1e90d3c8-7669-4bad-88e2-feea53eba771 tempest-CinderUnicodeTest-1089747710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6.d9813158-61db-42ac-9f29-6ff440d2cf49 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-db088ff9-ee1b-4aee-b781-d94fe776ded0 tempest-ProjectReaderTests-421706438 None] Lock "cinder-16df5f25-6b5a-4730-9763-3567130314fb-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:07 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6.d9813158-61db-42ac-9f29-6ff440d2cf49 1G Nov 04 19:07:07 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:07 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_64c06ba8-a713-4e0c-ae79-f465b82df590_njyd2fyadevstack@QuobyteHD /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b539f339-92ee-4530-b12e-abc8d2469509" returned: 0 in 0.580s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:07 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_64c06ba8-a713-4e0c-ae79-f465b82df590_njyd2fyadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b539f339-92ee-4530-b12e-abc8d2469509 {{(pid=87119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:07:07 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Converted 0.00 MB image at 0.00 MB/s Nov 04 19:07:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b539f339-92ee-4530-b12e-abc8d2469509 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:07 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b539f339-92ee-4530-b12e-abc8d2469509 1G Nov 04 19:07:07 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:07 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d8beca5e-9d53-4f36-897c-b8e29f9d0ccb tempest-CreateVolumesFromImageTest-120535797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6828ffc6-4aca-4a7d-a399-7b3622301b97" returned: 0 in 0.443s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d8beca5e-9d53-4f36-897c-b8e29f9d0ccb tempest-CreateVolumesFromImageTest-120535797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6828ffc6-4aca-4a7d-a399-7b3622301b97 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:07 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6828ffc6-4aca-4a7d-a399-7b3622301b97 Nov 04 19:07:07 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:07 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b539f339-92ee-4530-b12e-abc8d2469509 1G" returned: 0 in 0.352s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:07 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Downloaded image 64c06ba8-a713-4e0c-ae79-f465b82df590 ((None, [{'url': 'file:///opt/stack/data/glance/images/64c06ba8-a713-4e0c-ae79-f465b82df590', 'metadata': {}}])) to volume b539f339-92ee-4530-b12e-abc8d2469509 successfully. {{(pid=87119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 19:07:07 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Temporary image 64c06ba8-a713-4e0c-ae79-f465b82df590 for user 97c363e82d034c2fa10abf3a5c4a1630 is deleted. {{(pid=87119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 19:07:07 devstack cinder-volume[87119]: DEBUG cinder.volume.volume_utils [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Marking volume b539f339-92ee-4530-b12e-abc8d2469509 as bootable. {{(pid=87119) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 19:07:07 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Copying metadata from image 64c06ba8-a713-4e0c-ae79-f465b82df590 to b539f339-92ee-4530-b12e-abc8d2469509. {{(pid=87119) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 19:07:07 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Creating volume glance metadata for volume b539f339-92ee-4530-b12e-abc8d2469509 backed by image 64c06ba8-a713-4e0c-ae79-f465b82df590 with: {'image_id': '64c06ba8-a713-4e0c-ae79-f465b82df590', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '037aa38979883ec6c22a54d587fe4c3e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87119) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 19:07:07 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1e90d3c8-7669-4bad-88e2-feea53eba771 tempest-CinderUnicodeTest-1089747710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6.d9813158-61db-42ac-9f29-6ff440d2cf49 1G" returned: 0 in 0.485s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1e90d3c8-7669-4bad-88e2-feea53eba771 tempest-CinderUnicodeTest-1089747710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-738888f7-8bdc-41e4-9427-b85267572fe6 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6.d9813158-61db-42ac-9f29-6ff440d2cf49 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:07 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-738888f7-8bdc-41e4-9427-b85267572fe6 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6.d9813158-61db-42ac-9f29-6ff440d2cf49 Nov 04 19:07:07 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:07 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d8beca5e-9d53-4f36-897c-b8e29f9d0ccb tempest-CreateVolumesFromImageTest-120535797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6828ffc6-4aca-4a7d-a399-7b3622301b97" returned: 0 in 0.317s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d8beca5e-9d53-4f36-897c-b8e29f9d0ccb tempest-CreateVolumesFromImageTest-120535797 None] Lock "cinder-quobyte-6828ffc6-4aca-4a7d-a399-7b3622301b97" released by "delete_volume" :: held 0.818s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ff3976-5ba9-4f3b-9eb4-49f944606b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b539f339-92ee-4530-b12e-abc8d2469509', 'volume_size': 1, 'image_id': '64c06ba8-a713-4e0c-ae79-f465b82df590', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64c06ba8-a713-4e0c-ae79-f465b82df590', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '037aa38979883ec6c22a54d587fe4c3e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34d8e4e74c05484e921afe1014e7ae54', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e0930f170387eabe49026fc3ca3e76c38ee73859c27d56cce96f6b3e766fbc0de0779db2a7fa7146982475e41da3dbb0332213b2a2f094ede9b07cf35a3063e4', 'id': '64c06ba8-a713-4e0c-ae79-f465b82df590', 'created_at': datetime.datetime(2026, 11, 4, 18, 6, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 6, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64c06ba8-a713-4e0c-ae79-f465b82df590/file', 'properties': {}}, 'image_service': }' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66512e68-ad52-477a-a7cb-6cce7038a896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:07 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Volume volume-b539f339-92ee-4530-b12e-abc8d2469509 (b539f339-92ee-4530-b12e-abc8d2469509): created successfully Nov 04 19:07:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66512e68-ad52-477a-a7cb-6cce7038a896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:07 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Flow 'volume_create_manager' (be461b79-063f-4878-b06f-a32d1275a4a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:07 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-33e20fb1-85a4-4b62-a2ed-cf342179af5c tempest-VolumeImageDependencyTests-1105636050 None] Created volume successfully. Nov 04 19:07:07 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-d8beca5e-9d53-4f36-897c-b8e29f9d0ccb tempest-CreateVolumesFromImageTest-120535797 None] Created reservations ['ea6731ce-f6d3-4433-8183-9808ae648e49', 'e60367aa-116b-4ece-ae61-75bcc456a2f0', 'b1ca0489-e817-4638-9628-c8fc357690a2', '5ef09a38-b973-4b56-95ba-b9033c293426'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d8beca5e-9d53-4f36-897c-b8e29f9d0ccb tempest-CreateVolumesFromImageTest-120535797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d8beca5e-9d53-4f36-897c-b8e29f9d0ccb tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d8beca5e-9d53-4f36-897c-b8e29f9d0ccb tempest-CreateVolumesFromImageTest-120535797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d8beca5e-9d53-4f36-897c-b8e29f9d0ccb tempest-CreateVolumesFromImageTest-120535797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d8beca5e-9d53-4f36-897c-b8e29f9d0ccb tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d8beca5e-9d53-4f36-897c-b8e29f9d0ccb tempest-CreateVolumesFromImageTest-120535797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:08 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:07:08 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3dac1b87-c797-4b97-8b84-b0e9f70a389c tempest-CreateVolumesFromImageTest-120535797 None] Acquiring lock "cinder-f3ee0b7b-205f-4cb3-b76d-c6c016f346fd-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3dac1b87-c797-4b97-8b84-b0e9f70a389c tempest-CreateVolumesFromImageTest-120535797 None] Lock "cinder-f3ee0b7b-205f-4cb3-b76d-c6c016f346fd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:08 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1e90d3c8-7669-4bad-88e2-feea53eba771 tempest-CinderUnicodeTest-1089747710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-738888f7-8bdc-41e4-9427-b85267572fe6 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6.d9813158-61db-42ac-9f29-6ff440d2cf49" returned: 0 in 0.461s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3dac1b87-c797-4b97-8b84-b0e9f70a389c tempest-CreateVolumesFromImageTest-120535797 None] Acquiring lock "cinder-quobyte-f3ee0b7b-205f-4cb3-b76d-c6c016f346fd" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:08 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-1e90d3c8-7669-4bad-88e2-feea53eba771 tempest-CinderUnicodeTest-1089747710 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6.d9813158-61db-42ac-9f29-6ff440d2cf49 is being set with open permissions: ugo+rw Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1e90d3c8-7669-4bad-88e2-feea53eba771 tempest-CinderUnicodeTest-1089747710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6.d9813158-61db-42ac-9f29-6ff440d2cf49 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:08 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6.d9813158-61db-42ac-9f29-6ff440d2cf49 Nov 04 19:07:08 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3dac1b87-c797-4b97-8b84-b0e9f70a389c tempest-CreateVolumesFromImageTest-120535797 None] Lock "cinder-quobyte-f3ee0b7b-205f-4cb3-b76d-c6c016f346fd" acquired by "delete_volume" :: waited 0.054s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a87fba0-114a-43e5-a71b-60cbe5fafd51]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3dac1b87-c797-4b97-8b84-b0e9f70a389c tempest-CreateVolumesFromImageTest-120535797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f3ee0b7b-205f-4cb3-b76d-c6c016f346fd {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:08 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d8beca5e-9d53-4f36-897c-b8e29f9d0ccb tempest-CreateVolumesFromImageTest-120535797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.396s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-d8beca5e-9d53-4f36-897c-b8e29f9d0ccb tempest-CreateVolumesFromImageTest-120535797 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:08 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-d8beca5e-9d53-4f36-897c-b8e29f9d0ccb tempest-CreateVolumesFromImageTest-120535797 None] Deleted volume successfully. Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d8beca5e-9d53-4f36-897c-b8e29f9d0ccb tempest-CreateVolumesFromImageTest-120535797 None] Lock "cinder-6828ffc6-4aca-4a7d-a399-7b3622301b97-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:08 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f3ee0b7b-205f-4cb3-b76d-c6c016f346fd Nov 04 19:07:08 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:08 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1e90d3c8-7669-4bad-88e2-feea53eba771 tempest-CinderUnicodeTest-1089747710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6.d9813158-61db-42ac-9f29-6ff440d2cf49" returned: 0 in 0.304s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Flow 'volume_create_manager' (9138a933-044e-49d3-ba83-a7c2923b39da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbacf76c-71bc-4db5-98b2-45923355aa9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbacf76c-71bc-4db5-98b2-45923355aa9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-413456723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42e062a7-a189-43e1-8d17-d6a2c4400920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e06bd473564743b698ac5523d08c3fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:08Z,use_quota=True,user_id='6fc22b0379ef4e65ae31fdfa79981aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c28605c-64ec-45b4-965d-0028556c487b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c28605c-64ec-45b4-965d-0028556c487b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd1879f-5662-4251-a8dd-0529fefeb58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd1879f-5662-4251-a8dd-0529fefeb58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42e062a7-a189-43e1-8d17-d6a2c4400920', 'volume_name': 'volume-42e062a7-a189-43e1-8d17-d6a2c4400920', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6b1615-a23e-4bc7-a457-f807ec6f2078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6b1615-a23e-4bc7-a457-f807ec6f2078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9301615-3868-4e27-9db5-93e8c0ae8da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:08 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Volume 42e062a7-a189-43e1-8d17-d6a2c4400920: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42e062a7-a189-43e1-8d17-d6a2c4400920', 'volume_size': 1} Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1e90d3c8-7669-4bad-88e2-feea53eba771 tempest-CinderUnicodeTest-1089747710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:08 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6.info Nov 04 19:07:08 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:08 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3dac1b87-c797-4b97-8b84-b0e9f70a389c tempest-CreateVolumesFromImageTest-120535797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f3ee0b7b-205f-4cb3-b76d-c6c016f346fd" returned: 0 in 0.470s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3dac1b87-c797-4b97-8b84-b0e9f70a389c tempest-CreateVolumesFromImageTest-120535797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f3ee0b7b-205f-4cb3-b76d-c6c016f346fd {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:08 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f3ee0b7b-205f-4cb3-b76d-c6c016f346fd Nov 04 19:07:08 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:08 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1e90d3c8-7669-4bad-88e2-feea53eba771 tempest-CinderUnicodeTest-1089747710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6.info" returned: 0 in 0.273s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:08 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-1e90d3c8-7669-4bad-88e2-feea53eba771 tempest-CinderUnicodeTest-1089747710 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6.info is being set with open permissions: ugo+rw Nov 04 19:07:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1e90d3c8-7669-4bad-88e2-feea53eba771 tempest-CinderUnicodeTest-1089747710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:08 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6.info Nov 04 19:07:08 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:09 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3dac1b87-c797-4b97-8b84-b0e9f70a389c tempest-CreateVolumesFromImageTest-120535797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f3ee0b7b-205f-4cb3-b76d-c6c016f346fd" returned: 0 in 0.313s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3dac1b87-c797-4b97-8b84-b0e9f70a389c tempest-CreateVolumesFromImageTest-120535797 None] Lock "cinder-quobyte-f3ee0b7b-205f-4cb3-b76d-c6c016f346fd" released by "delete_volume" :: held 0.861s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-af342439-2333-47bb-984d-2e67e362127c tempest-VolumeImageDependencyTests-1105636050 None] Acquiring lock "cinder-b539f339-92ee-4530-b12e-abc8d2469509-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:09 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-af342439-2333-47bb-984d-2e67e362127c tempest-VolumeImageDependencyTests-1105636050 None] Lock "cinder-b539f339-92ee-4530-b12e-abc8d2469509-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1e90d3c8-7669-4bad-88e2-feea53eba771 tempest-CinderUnicodeTest-1089747710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6.info" returned: 0 in 0.289s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1e90d3c8-7669-4bad-88e2-feea53eba771 tempest-CinderUnicodeTest-1089747710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.535s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.605s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-413456723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42e062a7-a189-43e1-8d17-d6a2c4400920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e06bd473564743b698ac5523d08c3fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:08Z,use_quota=True,user_id='6fc22b0379ef4e65ae31fdfa79981aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Creating volume 42e062a7-a189-43e1-8d17-d6a2c4400920 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:09 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-3dac1b87-c797-4b97-8b84-b0e9f70a389c tempest-CreateVolumesFromImageTest-120535797 None] Created reservations ['53923788-817e-43ea-b4f5-3c302ff9d6a2', '59bf6522-2fbd-41f9-8503-9c7d22b9632a', 'b4ef9a35-2eac-4a77-aa21-5bb62b6cc92a', '46cc03de-2a88-42ab-87a9-71700bc68ced'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:09 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920 1073741824 Nov 04 19:07:09 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:09 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-1e90d3c8-7669-4bad-88e2-feea53eba771 tempest-CinderUnicodeTest-1089747710 None] Create snapshot completed successfully Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-af342439-2333-47bb-984d-2e67e362127c tempest-VolumeImageDependencyTests-1105636050 None] Acquiring lock "cinder-quobyte-b539f339-92ee-4530-b12e-abc8d2469509" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-af342439-2333-47bb-984d-2e67e362127c tempest-VolumeImageDependencyTests-1105636050 None] Lock "cinder-quobyte-b539f339-92ee-4530-b12e-abc8d2469509" acquired by "delete_volume" :: waited 0.028s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90b8be2-1e0a-4640-b950-fe3172908a47]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-af342439-2333-47bb-984d-2e67e362127c tempest-VolumeImageDependencyTests-1105636050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b539f339-92ee-4530-b12e-abc8d2469509 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3dac1b87-c797-4b97-8b84-b0e9f70a389c tempest-CreateVolumesFromImageTest-120535797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3dac1b87-c797-4b97-8b84-b0e9f70a389c tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3dac1b87-c797-4b97-8b84-b0e9f70a389c tempest-CreateVolumesFromImageTest-120535797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3dac1b87-c797-4b97-8b84-b0e9f70a389c tempest-CreateVolumesFromImageTest-120535797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3dac1b87-c797-4b97-8b84-b0e9f70a389c tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3dac1b87-c797-4b97-8b84-b0e9f70a389c tempest-CreateVolumesFromImageTest-120535797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:09 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:07:09 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:09 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b539f339-92ee-4530-b12e-abc8d2469509 Nov 04 19:07:09 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:09 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3dac1b87-c797-4b97-8b84-b0e9f70a389c tempest-CreateVolumesFromImageTest-120535797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.256s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-3dac1b87-c797-4b97-8b84-b0e9f70a389c tempest-CreateVolumesFromImageTest-120535797 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:09 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:09 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-3dac1b87-c797-4b97-8b84-b0e9f70a389c tempest-CreateVolumesFromImageTest-120535797 None] Deleted volume successfully. Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920 1073741824" returned: 0 in 0.469s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3dac1b87-c797-4b97-8b84-b0e9f70a389c tempest-CreateVolumesFromImageTest-120535797 None] Lock "cinder-f3ee0b7b-205f-4cb3-b76d-c6c016f346fd-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:09 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920 Nov 04 19:07:09 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-36307ab9-043a-49a4-b7b6-8011cc7c6cc6 tempest-CinderUnicodeTest-1089747710 None] Acquiring lock "cinder-d9813158-61db-42ac-9f29-6ff440d2cf49-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:09 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-af342439-2333-47bb-984d-2e67e362127c tempest-VolumeImageDependencyTests-1105636050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b539f339-92ee-4530-b12e-abc8d2469509" returned: 0 in 0.473s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-af342439-2333-47bb-984d-2e67e362127c tempest-VolumeImageDependencyTests-1105636050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b539f339-92ee-4530-b12e-abc8d2469509 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-36307ab9-043a-49a4-b7b6-8011cc7c6cc6 tempest-CinderUnicodeTest-1089747710 None] Lock "cinder-d9813158-61db-42ac-9f29-6ff440d2cf49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-36307ab9-043a-49a4-b7b6-8011cc7c6cc6 tempest-CinderUnicodeTest-1089747710 None] Acquiring lock "cinder-quobyte-738888f7-8bdc-41e4-9427-b85267572fe6" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:09 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b539f339-92ee-4530-b12e-abc8d2469509 Nov 04 19:07:09 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-36307ab9-043a-49a4-b7b6-8011cc7c6cc6 tempest-CinderUnicodeTest-1089747710 None] Lock "cinder-quobyte-738888f7-8bdc-41e4-9427-b85267572fe6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-36307ab9-043a-49a4-b7b6-8011cc7c6cc6 tempest-CinderUnicodeTest-1089747710 None] Acquiring lock "cinder-quobyte-d9813158-61db-42ac-9f29-6ff440d2cf49" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-36307ab9-043a-49a4-b7b6-8011cc7c6cc6 tempest-CinderUnicodeTest-1089747710 None] Lock "cinder-quobyte-d9813158-61db-42ac-9f29-6ff440d2cf49" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-36307ab9-043a-49a4-b7b6-8011cc7c6cc6 tempest-CinderUnicodeTest-1089747710 None] Deleting offline snapshot d9813158-61db-42ac-9f29-6ff440d2cf49 of volume 738888f7-8bdc-41e4-9427-b85267572fe6 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-36307ab9-043a-49a4-b7b6-8011cc7c6cc6 tempest-CinderUnicodeTest-1089747710 None] snapshot_file for this snap is: volume-738888f7-8bdc-41e4-9427-b85267572fe6.d9813158-61db-42ac-9f29-6ff440d2cf49 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe0bea4-e063-4894-b2a4-e9e0fce68429]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-36307ab9-043a-49a4-b7b6-8011cc7c6cc6 tempest-CinderUnicodeTest-1089747710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6.d9813158-61db-42ac-9f29-6ff440d2cf49 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:10 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920" returned: 0 in 0.314s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:10 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6.d9813158-61db-42ac-9f29-6ff440d2cf49 Nov 04 19:07:10 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9301615-3868-4e27-9db5-93e8c0ae8da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42e062a7-a189-43e1-8d17-d6a2c4400920', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9fe770-b8f5-481c-a292-0219b62e4786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:10 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Volume volume-42e062a7-a189-43e1-8d17-d6a2c4400920 (42e062a7-a189-43e1-8d17-d6a2c4400920): created successfully Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9fe770-b8f5-481c-a292-0219b62e4786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Flow 'volume_create_manager' (9138a933-044e-49d3-ba83-a7c2923b39da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:10 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-af342439-2333-47bb-984d-2e67e362127c tempest-VolumeImageDependencyTests-1105636050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b539f339-92ee-4530-b12e-abc8d2469509" returned: 0 in 0.290s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-af342439-2333-47bb-984d-2e67e362127c tempest-VolumeImageDependencyTests-1105636050 None] Lock "cinder-quobyte-b539f339-92ee-4530-b12e-abc8d2469509" released by "delete_volume" :: held 0.825s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:10 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-1e82f11e-aff5-4e67-a5c5-9316339eba2f tempest-ProjectReaderTests-421706438 None] Created volume successfully. Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-af342439-2333-47bb-984d-2e67e362127c tempest-VolumeImageDependencyTests-1105636050 None] Created reservations ['c79a4005-9357-4b47-8946-e25cc4f9566b', '5ce392e8-8e4d-45b0-b8c7-a109c14fb827', 'fb649403-61de-4ff3-b6b5-0db9c04db21e', '0c9d09df-11ef-4735-b2a6-fe0bf7ae88c2'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-af342439-2333-47bb-984d-2e67e362127c tempest-VolumeImageDependencyTests-1105636050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-af342439-2333-47bb-984d-2e67e362127c tempest-VolumeImageDependencyTests-1105636050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-af342439-2333-47bb-984d-2e67e362127c tempest-VolumeImageDependencyTests-1105636050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-af342439-2333-47bb-984d-2e67e362127c tempest-VolumeImageDependencyTests-1105636050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-af342439-2333-47bb-984d-2e67e362127c tempest-VolumeImageDependencyTests-1105636050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-af342439-2333-47bb-984d-2e67e362127c tempest-VolumeImageDependencyTests-1105636050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:10 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:07:10 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-17b37e79-ad22-4f9d-8335-bb6cde5e85a2 tempest-CreateVolumesFromImageTest-120535797 None] Acquiring lock "cinder-97350a76-c897-468d-87d5-acd744723bf6-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-17b37e79-ad22-4f9d-8335-bb6cde5e85a2 tempest-CreateVolumesFromImageTest-120535797 None] Lock "cinder-97350a76-c897-468d-87d5-acd744723bf6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:10 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-36307ab9-043a-49a4-b7b6-8011cc7c6cc6 tempest-CinderUnicodeTest-1089747710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6.d9813158-61db-42ac-9f29-6ff440d2cf49" returned: 0 in 0.553s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-36307ab9-043a-49a4-b7b6-8011cc7c6cc6 tempest-CinderUnicodeTest-1089747710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-738888f7-8bdc-41e4-9427-b85267572fe6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-17b37e79-ad22-4f9d-8335-bb6cde5e85a2 tempest-CreateVolumesFromImageTest-120535797 None] Acquiring lock "cinder-quobyte-97350a76-c897-468d-87d5-acd744723bf6" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d38e7aa-9ebc-4826-b26f-940e152b7b99]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-36307ab9-043a-49a4-b7b6-8011cc7c6cc6 tempest-CinderUnicodeTest-1089747710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-17b37e79-ad22-4f9d-8335-bb6cde5e85a2 tempest-CreateVolumesFromImageTest-120535797 None] Lock "cinder-quobyte-97350a76-c897-468d-87d5-acd744723bf6" acquired by "delete_volume" :: waited 0.052s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2f8a37-3494-4da2-8d97-0bbdd95fe878]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-17b37e79-ad22-4f9d-8335-bb6cde5e85a2 tempest-CreateVolumesFromImageTest-120535797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-97350a76-c897-468d-87d5-acd744723bf6 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:10 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-af342439-2333-47bb-984d-2e67e362127c tempest-VolumeImageDependencyTests-1105636050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.460s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-af342439-2333-47bb-984d-2e67e362127c tempest-VolumeImageDependencyTests-1105636050 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:10 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6 Nov 04 19:07:10 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:10 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-97350a76-c897-468d-87d5-acd744723bf6 Nov 04 19:07:10 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:10 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-af342439-2333-47bb-984d-2e67e362127c tempest-VolumeImageDependencyTests-1105636050 None] Deleted volume successfully. Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-af342439-2333-47bb-984d-2e67e362127c tempest-VolumeImageDependencyTests-1105636050 None] Lock "cinder-b539f339-92ee-4530-b12e-abc8d2469509-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5b977748-91d3-4bd3-bead-686dc03d4cbb tempest-ProjectReaderTests-421706438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5b977748-91d3-4bd3-bead-686dc03d4cbb tempest-ProjectReaderTests-421706438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-5b977748-91d3-4bd3-bead-686dc03d4cbb tempest-ProjectReaderTests-421706438 None] Creating offline snapshot 7ec13f3c-21b4-4dc1-bfad-5bbd2c59840a of volume 42e062a7-a189-43e1-8d17-d6a2c4400920 {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:07:11 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e10ede-e848-456e-9652-59cf5763a280]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5b977748-91d3-4bd3-bead-686dc03d4cbb tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:11 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-36307ab9-043a-49a4-b7b6-8011cc7c6cc6 tempest-CinderUnicodeTest-1089747710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6" returned: 0 in 0.580s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-36307ab9-043a-49a4-b7b6-8011cc7c6cc6 tempest-CinderUnicodeTest-1089747710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6.d9813158-61db-42ac-9f29-6ff440d2cf49 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:11 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920 Nov 04 19:07:11 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:11 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6.d9813158-61db-42ac-9f29-6ff440d2cf49 Nov 04 19:07:11 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:11 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-17b37e79-ad22-4f9d-8335-bb6cde5e85a2 tempest-CreateVolumesFromImageTest-120535797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-97350a76-c897-468d-87d5-acd744723bf6" returned: 0 in 0.580s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-17b37e79-ad22-4f9d-8335-bb6cde5e85a2 tempest-CreateVolumesFromImageTest-120535797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-97350a76-c897-468d-87d5-acd744723bf6 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:11 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-97350a76-c897-468d-87d5-acd744723bf6 Nov 04 19:07:11 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:11 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5b977748-91d3-4bd3-bead-686dc03d4cbb tempest-ProjectReaderTests-421706438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920" returned: 0 in 0.479s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5b977748-91d3-4bd3-bead-686dc03d4cbb tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920.7ec13f3c-21b4-4dc1-bfad-5bbd2c59840a 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:11 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920.7ec13f3c-21b4-4dc1-bfad-5bbd2c59840a 1G Nov 04 19:07:11 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:11 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-17b37e79-ad22-4f9d-8335-bb6cde5e85a2 tempest-CreateVolumesFromImageTest-120535797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-97350a76-c897-468d-87d5-acd744723bf6" returned: 0 in 0.389s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:11 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-17b37e79-ad22-4f9d-8335-bb6cde5e85a2 tempest-CreateVolumesFromImageTest-120535797 None] Lock "cinder-quobyte-97350a76-c897-468d-87d5-acd744723bf6" released by "delete_volume" :: held 1.046s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:11 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-36307ab9-043a-49a4-b7b6-8011cc7c6cc6 tempest-CinderUnicodeTest-1089747710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6.d9813158-61db-42ac-9f29-6ff440d2cf49" returned: 0 in 0.591s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-36307ab9-043a-49a4-b7b6-8011cc7c6cc6 tempest-CinderUnicodeTest-1089747710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6.d9813158-61db-42ac-9f29-6ff440d2cf49 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:11 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6.d9813158-61db-42ac-9f29-6ff440d2cf49 Nov 04 19:07:11 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:11 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-17b37e79-ad22-4f9d-8335-bb6cde5e85a2 tempest-CreateVolumesFromImageTest-120535797 None] Created reservations ['c8ea0bd4-9615-4e0b-994c-4e6eaff80906', 'fda27b75-877f-4d38-8dbf-eb6d372e87ca', 'b4e73c59-73ba-4c64-ad3d-f15f8c3ae088', 'e64474d7-6f49-4dc8-aa86-6675e07af380'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-17b37e79-ad22-4f9d-8335-bb6cde5e85a2 tempest-CreateVolumesFromImageTest-120535797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-17b37e79-ad22-4f9d-8335-bb6cde5e85a2 tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:11 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-17b37e79-ad22-4f9d-8335-bb6cde5e85a2 tempest-CreateVolumesFromImageTest-120535797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:11 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-17b37e79-ad22-4f9d-8335-bb6cde5e85a2 tempest-CreateVolumesFromImageTest-120535797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-17b37e79-ad22-4f9d-8335-bb6cde5e85a2 tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-17b37e79-ad22-4f9d-8335-bb6cde5e85a2 tempest-CreateVolumesFromImageTest-120535797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:11 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:07:11 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:12 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-36307ab9-043a-49a4-b7b6-8011cc7c6cc6 tempest-CinderUnicodeTest-1089747710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6.d9813158-61db-42ac-9f29-6ff440d2cf49" returned: 0 in 0.359s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:12 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5b977748-91d3-4bd3-bead-686dc03d4cbb tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920.7ec13f3c-21b4-4dc1-bfad-5bbd2c59840a 1G" returned: 0 in 0.653s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5b977748-91d3-4bd3-bead-686dc03d4cbb tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42e062a7-a189-43e1-8d17-d6a2c4400920 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920.7ec13f3c-21b4-4dc1-bfad-5bbd2c59840a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-36307ab9-043a-49a4-b7b6-8011cc7c6cc6 tempest-CinderUnicodeTest-1089747710 None] Lock "cinder-quobyte-d9813158-61db-42ac-9f29-6ff440d2cf49" released by "_delete_snapshot" :: held 2.286s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-36307ab9-043a-49a4-b7b6-8011cc7c6cc6 tempest-CinderUnicodeTest-1089747710 None] Lock "cinder-quobyte-738888f7-8bdc-41e4-9427-b85267572fe6" released by "delete_snapshot" :: held 2.317s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:12 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42e062a7-a189-43e1-8d17-d6a2c4400920 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920.7ec13f3c-21b4-4dc1-bfad-5bbd2c59840a Nov 04 19:07:12 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:12 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-36307ab9-043a-49a4-b7b6-8011cc7c6cc6 tempest-CinderUnicodeTest-1089747710 None] Created reservations ['9c45e951-a032-4c77-8135-d6d7c990da2e', '36dacb11-928d-469a-997c-4d458a61234d', '483bb41a-e3e6-4c29-925a-6ceeff9f6ffc', '2d017aec-edf6-445c-9657-78cb76349e45'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:12 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-17b37e79-ad22-4f9d-8335-bb6cde5e85a2 tempest-CreateVolumesFromImageTest-120535797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.404s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:12 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-17b37e79-ad22-4f9d-8335-bb6cde5e85a2 tempest-CreateVolumesFromImageTest-120535797 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:12 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-17b37e79-ad22-4f9d-8335-bb6cde5e85a2 tempest-CreateVolumesFromImageTest-120535797 None] Deleted volume successfully. Nov 04 19:07:12 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-36307ab9-043a-49a4-b7b6-8011cc7c6cc6 tempest-CinderUnicodeTest-1089747710 None] Delete snapshot completed successfully. Nov 04 19:07:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-17b37e79-ad22-4f9d-8335-bb6cde5e85a2 tempest-CreateVolumesFromImageTest-120535797 None] Lock "cinder-97350a76-c897-468d-87d5-acd744723bf6-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-36307ab9-043a-49a4-b7b6-8011cc7c6cc6 tempest-CinderUnicodeTest-1089747710 None] Lock "cinder-d9813158-61db-42ac-9f29-6ff440d2cf49-delete_snapshot" released by "delete_snapshot" :: held 2.563s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:12 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5b977748-91d3-4bd3-bead-686dc03d4cbb tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42e062a7-a189-43e1-8d17-d6a2c4400920 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920.7ec13f3c-21b4-4dc1-bfad-5bbd2c59840a" returned: 0 in 0.388s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:12 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-5b977748-91d3-4bd3-bead-686dc03d4cbb tempest-ProjectReaderTests-421706438 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920.7ec13f3c-21b4-4dc1-bfad-5bbd2c59840a is being set with open permissions: ugo+rw Nov 04 19:07:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5b977748-91d3-4bd3-bead-686dc03d4cbb tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920.7ec13f3c-21b4-4dc1-bfad-5bbd2c59840a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:12 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920.7ec13f3c-21b4-4dc1-bfad-5bbd2c59840a Nov 04 19:07:12 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9be159ae-7285-425d-b632-b74263624d8b tempest-CreateVolumesFromImageTest-120535797 None] Acquiring lock "cinder-0756a8cc-bba0-4769-a558-e5d9f09e17be-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9be159ae-7285-425d-b632-b74263624d8b tempest-CreateVolumesFromImageTest-120535797 None] Lock "cinder-0756a8cc-bba0-4769-a558-e5d9f09e17be-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9be159ae-7285-425d-b632-b74263624d8b tempest-CreateVolumesFromImageTest-120535797 None] Acquiring lock "cinder-quobyte-0756a8cc-bba0-4769-a558-e5d9f09e17be" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:12 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5b977748-91d3-4bd3-bead-686dc03d4cbb tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920.7ec13f3c-21b4-4dc1-bfad-5bbd2c59840a" returned: 0 in 0.321s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9be159ae-7285-425d-b632-b74263624d8b tempest-CreateVolumesFromImageTest-120535797 None] Lock "cinder-quobyte-0756a8cc-bba0-4769-a558-e5d9f09e17be" acquired by "delete_volume" :: waited 0.023s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5b977748-91d3-4bd3-bead-686dc03d4cbb tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:12 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[178680f0-b253-4305-89be-a49a7decde4f]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9be159ae-7285-425d-b632-b74263624d8b tempest-CreateVolumesFromImageTest-120535797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-0756a8cc-bba0-4769-a558-e5d9f09e17be {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:12 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920.info Nov 04 19:07:12 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:13 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-0756a8cc-bba0-4769-a558-e5d9f09e17be Nov 04 19:07:13 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:13 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6dd58bc8-282e-4018-a31e-c21cc78c333f tempest-CinderUnicodeTest-1089747710 None] Acquiring lock "cinder-738888f7-8bdc-41e4-9427-b85267572fe6-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:13 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6dd58bc8-282e-4018-a31e-c21cc78c333f tempest-CinderUnicodeTest-1089747710 None] Lock "cinder-738888f7-8bdc-41e4-9427-b85267572fe6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:13 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6dd58bc8-282e-4018-a31e-c21cc78c333f tempest-CinderUnicodeTest-1089747710 None] Acquiring lock "cinder-quobyte-738888f7-8bdc-41e4-9427-b85267572fe6" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:13 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6dd58bc8-282e-4018-a31e-c21cc78c333f tempest-CinderUnicodeTest-1089747710 None] Lock "cinder-quobyte-738888f7-8bdc-41e4-9427-b85267572fe6" acquired by "delete_volume" :: waited 0.032s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:13 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5b977748-91d3-4bd3-bead-686dc03d4cbb tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920.info" returned: 0 in 0.372s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:13 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-5b977748-91d3-4bd3-bead-686dc03d4cbb tempest-ProjectReaderTests-421706438 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920.info is being set with open permissions: ugo+rw Nov 04 19:07:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5b977748-91d3-4bd3-bead-686dc03d4cbb tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:13 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7f0cad-e99b-43fe-8d03-922101d218c9]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6dd58bc8-282e-4018-a31e-c21cc78c333f tempest-CinderUnicodeTest-1089747710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:13 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920.info Nov 04 19:07:13 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:13 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9be159ae-7285-425d-b632-b74263624d8b tempest-CreateVolumesFromImageTest-120535797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-0756a8cc-bba0-4769-a558-e5d9f09e17be" returned: 0 in 0.502s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9be159ae-7285-425d-b632-b74263624d8b tempest-CreateVolumesFromImageTest-120535797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-0756a8cc-bba0-4769-a558-e5d9f09e17be {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:13 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6 Nov 04 19:07:13 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:13 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-0756a8cc-bba0-4769-a558-e5d9f09e17be Nov 04 19:07:13 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:13 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5b977748-91d3-4bd3-bead-686dc03d4cbb tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920.info" returned: 0 in 0.313s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5b977748-91d3-4bd3-bead-686dc03d4cbb tempest-ProjectReaderTests-421706438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.648s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:13 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-5b977748-91d3-4bd3-bead-686dc03d4cbb tempest-ProjectReaderTests-421706438 None] Create snapshot completed successfully Nov 04 19:07:13 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6dd58bc8-282e-4018-a31e-c21cc78c333f tempest-CinderUnicodeTest-1089747710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6" returned: 0 in 0.435s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6dd58bc8-282e-4018-a31e-c21cc78c333f tempest-CinderUnicodeTest-1089747710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:13 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9be159ae-7285-425d-b632-b74263624d8b tempest-CreateVolumesFromImageTest-120535797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-0756a8cc-bba0-4769-a558-e5d9f09e17be" returned: 0 in 0.336s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:13 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6 Nov 04 19:07:13 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:13 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9be159ae-7285-425d-b632-b74263624d8b tempest-CreateVolumesFromImageTest-120535797 None] Lock "cinder-quobyte-0756a8cc-bba0-4769-a558-e5d9f09e17be" released by "delete_volume" :: held 0.923s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:13 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-9be159ae-7285-425d-b632-b74263624d8b tempest-CreateVolumesFromImageTest-120535797 None] Created reservations ['f0dc53bb-3a36-47fa-be7c-4dbe6d2456a7', '1e706484-de1a-4cac-a24a-ec539e7d85f4', '666b9cb9-9661-4bd4-a0f6-b7de26a033d6', '007728da-e1b0-4ab7-a610-e33b935b1ad1'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9be159ae-7285-425d-b632-b74263624d8b tempest-CreateVolumesFromImageTest-120535797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9be159ae-7285-425d-b632-b74263624d8b tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:13 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9be159ae-7285-425d-b632-b74263624d8b tempest-CreateVolumesFromImageTest-120535797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:13 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9be159ae-7285-425d-b632-b74263624d8b tempest-CreateVolumesFromImageTest-120535797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9be159ae-7285-425d-b632-b74263624d8b tempest-CreateVolumesFromImageTest-120535797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9be159ae-7285-425d-b632-b74263624d8b tempest-CreateVolumesFromImageTest-120535797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:13 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:07:13 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:14 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6dd58bc8-282e-4018-a31e-c21cc78c333f tempest-CinderUnicodeTest-1089747710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-738888f7-8bdc-41e4-9427-b85267572fe6" returned: 0 in 0.342s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6dd58bc8-282e-4018-a31e-c21cc78c333f tempest-CinderUnicodeTest-1089747710 None] Lock "cinder-quobyte-738888f7-8bdc-41e4-9427-b85267572fe6" released by "delete_volume" :: held 0.888s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4ee77b55-7d7a-4e7a-a6a8-d6b3e879bc92 tempest-ProjectReaderTests-421706438 None] Acquiring lock "cinder-7ec13f3c-21b4-4dc1-bfad-5bbd2c59840a-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-6dd58bc8-282e-4018-a31e-c21cc78c333f tempest-CinderUnicodeTest-1089747710 None] Created reservations ['7f02d026-eae2-424e-ae59-795f4ba56af0', '5527c31c-7595-4139-8487-9f834a136e07', 'fe7b6c56-e0b3-43f3-bbcd-ebbe43388cd5', 'da4d48f3-f186-450a-a18c-b3355b416f83'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4ee77b55-7d7a-4e7a-a6a8-d6b3e879bc92 tempest-ProjectReaderTests-421706438 None] Lock "cinder-7ec13f3c-21b4-4dc1-bfad-5bbd2c59840a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4ee77b55-7d7a-4e7a-a6a8-d6b3e879bc92 tempest-ProjectReaderTests-421706438 None] Acquiring lock "cinder-quobyte-42e062a7-a189-43e1-8d17-d6a2c4400920" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4ee77b55-7d7a-4e7a-a6a8-d6b3e879bc92 tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-42e062a7-a189-43e1-8d17-d6a2c4400920" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4ee77b55-7d7a-4e7a-a6a8-d6b3e879bc92 tempest-ProjectReaderTests-421706438 None] Acquiring lock "cinder-quobyte-7ec13f3c-21b4-4dc1-bfad-5bbd2c59840a" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:14 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9be159ae-7285-425d-b632-b74263624d8b tempest-CreateVolumesFromImageTest-120535797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.333s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-9be159ae-7285-425d-b632-b74263624d8b tempest-CreateVolumesFromImageTest-120535797 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:14 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-9be159ae-7285-425d-b632-b74263624d8b tempest-CreateVolumesFromImageTest-120535797 None] Deleted volume successfully. Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4ee77b55-7d7a-4e7a-a6a8-d6b3e879bc92 tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-7ec13f3c-21b4-4dc1-bfad-5bbd2c59840a" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-4ee77b55-7d7a-4e7a-a6a8-d6b3e879bc92 tempest-ProjectReaderTests-421706438 None] Deleting offline snapshot 7ec13f3c-21b4-4dc1-bfad-5bbd2c59840a of volume 42e062a7-a189-43e1-8d17-d6a2c4400920 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-4ee77b55-7d7a-4e7a-a6a8-d6b3e879bc92 tempest-ProjectReaderTests-421706438 None] snapshot_file for this snap is: volume-42e062a7-a189-43e1-8d17-d6a2c4400920.7ec13f3c-21b4-4dc1-bfad-5bbd2c59840a {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9be159ae-7285-425d-b632-b74263624d8b tempest-CreateVolumesFromImageTest-120535797 None] Lock "cinder-0756a8cc-bba0-4769-a558-e5d9f09e17be-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c983d5e3-97b2-43fe-ae4e-356b4c9e877a]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4ee77b55-7d7a-4e7a-a6a8-d6b3e879bc92 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920.7ec13f3c-21b4-4dc1-bfad-5bbd2c59840a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6dd58bc8-282e-4018-a31e-c21cc78c333f tempest-CinderUnicodeTest-1089747710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6dd58bc8-282e-4018-a31e-c21cc78c333f tempest-CinderUnicodeTest-1089747710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-6dd58bc8-282e-4018-a31e-c21cc78c333f tempest-CinderUnicodeTest-1089747710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-6dd58bc8-282e-4018-a31e-c21cc78c333f tempest-CinderUnicodeTest-1089747710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6dd58bc8-282e-4018-a31e-c21cc78c333f tempest-CinderUnicodeTest-1089747710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6dd58bc8-282e-4018-a31e-c21cc78c333f tempest-CinderUnicodeTest-1089747710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:14 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:07:14 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d5c2808e-38dd-4277-ada5-9eb7e4732b6c tempest-CinderUnicodeTest-1089747710 None] Acquiring lock "cinder-83403f70-4d14-4d33-bd8f-e86cb98ee644-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d5c2808e-38dd-4277-ada5-9eb7e4732b6c tempest-CinderUnicodeTest-1089747710 None] Lock "cinder-83403f70-4d14-4d33-bd8f-e86cb98ee644-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d5c2808e-38dd-4277-ada5-9eb7e4732b6c tempest-CinderUnicodeTest-1089747710 None] Acquiring lock "cinder-quobyte-83403f70-4d14-4d33-bd8f-e86cb98ee644" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d5c2808e-38dd-4277-ada5-9eb7e4732b6c tempest-CinderUnicodeTest-1089747710 None] Lock "cinder-quobyte-83403f70-4d14-4d33-bd8f-e86cb98ee644" acquired by "delete_volume" :: waited 0.021s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:14 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920.7ec13f3c-21b4-4dc1-bfad-5bbd2c59840a Nov 04 19:07:14 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[083fabc9-2df6-4605-ae08-baad2e478b4a]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d5c2808e-38dd-4277-ada5-9eb7e4732b6c tempest-CinderUnicodeTest-1089747710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-83403f70-4d14-4d33-bd8f-e86cb98ee644 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:14 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-83403f70-4d14-4d33-bd8f-e86cb98ee644 Nov 04 19:07:14 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:14 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6dd58bc8-282e-4018-a31e-c21cc78c333f tempest-CinderUnicodeTest-1089747710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.330s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-6dd58bc8-282e-4018-a31e-c21cc78c333f tempest-CinderUnicodeTest-1089747710 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:14 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-6dd58bc8-282e-4018-a31e-c21cc78c333f tempest-CinderUnicodeTest-1089747710 None] Deleted volume successfully. Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6dd58bc8-282e-4018-a31e-c21cc78c333f tempest-CinderUnicodeTest-1089747710 None] Lock "cinder-738888f7-8bdc-41e4-9427-b85267572fe6-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:14 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4ee77b55-7d7a-4e7a-a6a8-d6b3e879bc92 tempest-ProjectReaderTests-421706438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920.7ec13f3c-21b4-4dc1-bfad-5bbd2c59840a" returned: 0 in 0.519s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-4ee77b55-7d7a-4e7a-a6a8-d6b3e879bc92 tempest-ProjectReaderTests-421706438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42e062a7-a189-43e1-8d17-d6a2c4400920(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2758ef-99a5-4be8-be3b-366e982f4448]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4ee77b55-7d7a-4e7a-a6a8-d6b3e879bc92 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:15 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920 Nov 04 19:07:15 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:15 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d5c2808e-38dd-4277-ada5-9eb7e4732b6c tempest-CinderUnicodeTest-1089747710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-83403f70-4d14-4d33-bd8f-e86cb98ee644" returned: 0 in 0.447s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d5c2808e-38dd-4277-ada5-9eb7e4732b6c tempest-CinderUnicodeTest-1089747710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-83403f70-4d14-4d33-bd8f-e86cb98ee644 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:15 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-83403f70-4d14-4d33-bd8f-e86cb98ee644 Nov 04 19:07:15 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:15 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4ee77b55-7d7a-4e7a-a6a8-d6b3e879bc92 tempest-ProjectReaderTests-421706438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920" returned: 0 in 0.421s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4ee77b55-7d7a-4e7a-a6a8-d6b3e879bc92 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920.7ec13f3c-21b4-4dc1-bfad-5bbd2c59840a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:15 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920.7ec13f3c-21b4-4dc1-bfad-5bbd2c59840a Nov 04 19:07:15 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:15 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d5c2808e-38dd-4277-ada5-9eb7e4732b6c tempest-CinderUnicodeTest-1089747710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-83403f70-4d14-4d33-bd8f-e86cb98ee644" returned: 0 in 0.331s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:15 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d5c2808e-38dd-4277-ada5-9eb7e4732b6c tempest-CinderUnicodeTest-1089747710 None] Lock "cinder-quobyte-83403f70-4d14-4d33-bd8f-e86cb98ee644" released by "delete_volume" :: held 0.868s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:15 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-d5c2808e-38dd-4277-ada5-9eb7e4732b6c tempest-CinderUnicodeTest-1089747710 None] Created reservations ['be02f644-9615-43e5-af68-33fa451f2d06', '1ad50641-b302-43e5-8c33-1a209eae0e42', 'c59df1e9-2083-44aa-acb0-4bb5c506fd11', '7aa05dac-2c9f-4c7f-b909-0b4dafecfc33'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d5c2808e-38dd-4277-ada5-9eb7e4732b6c tempest-CinderUnicodeTest-1089747710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d5c2808e-38dd-4277-ada5-9eb7e4732b6c tempest-CinderUnicodeTest-1089747710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:15 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d5c2808e-38dd-4277-ada5-9eb7e4732b6c tempest-CinderUnicodeTest-1089747710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:15 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d5c2808e-38dd-4277-ada5-9eb7e4732b6c tempest-CinderUnicodeTest-1089747710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d5c2808e-38dd-4277-ada5-9eb7e4732b6c tempest-CinderUnicodeTest-1089747710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d5c2808e-38dd-4277-ada5-9eb7e4732b6c tempest-CinderUnicodeTest-1089747710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:15 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:07:15 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:15 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4ee77b55-7d7a-4e7a-a6a8-d6b3e879bc92 tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920.7ec13f3c-21b4-4dc1-bfad-5bbd2c59840a" returned: 0 in 0.540s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4ee77b55-7d7a-4e7a-a6a8-d6b3e879bc92 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920.7ec13f3c-21b4-4dc1-bfad-5bbd2c59840a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:15 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920.7ec13f3c-21b4-4dc1-bfad-5bbd2c59840a Nov 04 19:07:15 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:16 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d5c2808e-38dd-4277-ada5-9eb7e4732b6c tempest-CinderUnicodeTest-1089747710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.457s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:16 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-d5c2808e-38dd-4277-ada5-9eb7e4732b6c tempest-CinderUnicodeTest-1089747710 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:16 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-d5c2808e-38dd-4277-ada5-9eb7e4732b6c tempest-CinderUnicodeTest-1089747710 None] Deleted volume successfully. Nov 04 19:07:16 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d5c2808e-38dd-4277-ada5-9eb7e4732b6c tempest-CinderUnicodeTest-1089747710 None] Lock "cinder-83403f70-4d14-4d33-bd8f-e86cb98ee644-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:16 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4ee77b55-7d7a-4e7a-a6a8-d6b3e879bc92 tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920.7ec13f3c-21b4-4dc1-bfad-5bbd2c59840a" returned: 0 in 0.445s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:16 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4ee77b55-7d7a-4e7a-a6a8-d6b3e879bc92 tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-7ec13f3c-21b4-4dc1-bfad-5bbd2c59840a" released by "_delete_snapshot" :: held 2.064s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:16 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4ee77b55-7d7a-4e7a-a6a8-d6b3e879bc92 tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-42e062a7-a189-43e1-8d17-d6a2c4400920" released by "delete_snapshot" :: held 2.105s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:16 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-4ee77b55-7d7a-4e7a-a6a8-d6b3e879bc92 tempest-ProjectReaderTests-421706438 None] Created reservations ['eafe802a-fd59-42fa-8513-5edfa9b463f4', '7b3818a7-e2df-4bcc-998a-d442d87e49ca', '6c5ba576-73e4-4ad5-98bd-885135ed25c4', '6e3071dd-61f6-4685-8045-ceafdaca43cf'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:16 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-4ee77b55-7d7a-4e7a-a6a8-d6b3e879bc92 tempest-ProjectReaderTests-421706438 None] Delete snapshot completed successfully. Nov 04 19:07:16 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4ee77b55-7d7a-4e7a-a6a8-d6b3e879bc92 tempest-ProjectReaderTests-421706438 None] Lock "cinder-7ec13f3c-21b4-4dc1-bfad-5bbd2c59840a-delete_snapshot" released by "delete_snapshot" :: held 2.349s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:17 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f9b237d5-791d-41b8-bd52-0bba170e1ee2 tempest-ProjectReaderTests-421706438 None] Acquiring lock "cinder-42e062a7-a189-43e1-8d17-d6a2c4400920-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:17 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f9b237d5-791d-41b8-bd52-0bba170e1ee2 tempest-ProjectReaderTests-421706438 None] Lock "cinder-42e062a7-a189-43e1-8d17-d6a2c4400920-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:17 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f9b237d5-791d-41b8-bd52-0bba170e1ee2 tempest-ProjectReaderTests-421706438 None] Acquiring lock "cinder-quobyte-42e062a7-a189-43e1-8d17-d6a2c4400920" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:17 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f9b237d5-791d-41b8-bd52-0bba170e1ee2 tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-42e062a7-a189-43e1-8d17-d6a2c4400920" acquired by "delete_volume" :: waited 0.025s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:17 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfc202a-c344-4ba7-ad86-a4afd7d337a2]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f9b237d5-791d-41b8-bd52-0bba170e1ee2 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:17 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920 Nov 04 19:07:17 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:18 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f9b237d5-791d-41b8-bd52-0bba170e1ee2 tempest-ProjectReaderTests-421706438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920" returned: 0 in 0.434s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f9b237d5-791d-41b8-bd52-0bba170e1ee2 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:18 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920 Nov 04 19:07:18 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:18 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f9b237d5-791d-41b8-bd52-0bba170e1ee2 tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-42e062a7-a189-43e1-8d17-d6a2c4400920" returned: 0 in 0.383s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:18 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f9b237d5-791d-41b8-bd52-0bba170e1ee2 tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-42e062a7-a189-43e1-8d17-d6a2c4400920" released by "delete_volume" :: held 0.925s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:18 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-f9b237d5-791d-41b8-bd52-0bba170e1ee2 tempest-ProjectReaderTests-421706438 None] Created reservations ['d850ca3f-3f69-4aff-8042-ac7a397326f1', '93fa95fd-4de2-430a-92bf-628a805ee5f8', 'b6a16a97-426f-480f-bcb4-3a69d96892b3', '751fa769-3d30-4215-b439-b8705698d7c1'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f9b237d5-791d-41b8-bd52-0bba170e1ee2 tempest-ProjectReaderTests-421706438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f9b237d5-791d-41b8-bd52-0bba170e1ee2 tempest-ProjectReaderTests-421706438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:18 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f9b237d5-791d-41b8-bd52-0bba170e1ee2 tempest-ProjectReaderTests-421706438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:18 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f9b237d5-791d-41b8-bd52-0bba170e1ee2 tempest-ProjectReaderTests-421706438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f9b237d5-791d-41b8-bd52-0bba170e1ee2 tempest-ProjectReaderTests-421706438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f9b237d5-791d-41b8-bd52-0bba170e1ee2 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:18 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:07:18 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:19 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f9b237d5-791d-41b8-bd52-0bba170e1ee2 tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.309s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:19 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-f9b237d5-791d-41b8-bd52-0bba170e1ee2 tempest-ProjectReaderTests-421706438 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:19 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-f9b237d5-791d-41b8-bd52-0bba170e1ee2 tempest-ProjectReaderTests-421706438 None] Deleted volume successfully. Nov 04 19:07:19 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f9b237d5-791d-41b8-bd52-0bba170e1ee2 tempest-ProjectReaderTests-421706438 None] Lock "cinder-42e062a7-a189-43e1-8d17-d6a2c4400920-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Flow 'volume_create_manager' (2792e44f-e835-4d4b-9d5a-68e638a1c7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2243170-3549-47d6-ad40-60caa0801a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2243170-3549-47d6-ad40-60caa0801a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-999139909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7809a5f8-487e-4869-8b08-ac6e2d72b870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcdf041f6194693b5254c8bec2846fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:20Z,use_quota=True,user_id='4341d1ecf43a43bfa1baf34455c76d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9bc7e4-17fd-4b92-91b9-8940087e8a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9bc7e4-17fd-4b92-91b9-8940087e8a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a875f4f-c3b3-4760-a5d5-2d0f9c346769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a875f4f-c3b3-4760-a5d5-2d0f9c346769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7809a5f8-487e-4869-8b08-ac6e2d72b870', 'volume_name': 'volume-7809a5f8-487e-4869-8b08-ac6e2d72b870', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0cae785-cb04-4b7e-b89c-d1fea551e03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0cae785-cb04-4b7e-b89c-d1fea551e03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c16aa2c-7484-4a75-bf03-4e6e64c8889c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:20 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Volume 7809a5f8-487e-4869-8b08-ac6e2d72b870: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7809a5f8-487e-4869-8b08-ac6e2d72b870', 'volume_size': 1} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-999139909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7809a5f8-487e-4869-8b08-ac6e2d72b870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcdf041f6194693b5254c8bec2846fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:20Z,use_quota=True,user_id='4341d1ecf43a43bfa1baf34455c76d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Creating volume 7809a5f8-487e-4869-8b08-ac6e2d72b870 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:20 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:20 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870 1073741824 Nov 04 19:07:20 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Flow 'volume_create_manager' (d7999f00-942f-477d-9677-630925e53a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23cd3cf6-845b-4ef1-bb59-7bf74f6f0917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23cd3cf6-845b-4ef1-bb59-7bf74f6f0917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-315804627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e6144e-c47d-499f-9658-d5c1db66241f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e06bd473564743b698ac5523d08c3fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:21Z,use_quota=True,user_id='6fc22b0379ef4e65ae31fdfa79981aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33cf5b7b-4d82-45f1-a3f9-e33d08134db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33cf5b7b-4d82-45f1-a3f9-e33d08134db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d12188-06f2-48ac-9fc7-8ed99a5c47db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d12188-06f2-48ac-9fc7-8ed99a5c47db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45e6144e-c47d-499f-9658-d5c1db66241f', 'volume_name': 'volume-45e6144e-c47d-499f-9658-d5c1db66241f', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf31396b-07fc-40cb-b09d-e59ba330d876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf31396b-07fc-40cb-b09d-e59ba330d876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b74b8325-f29a-4b5f-b1e9-282e5b909fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:20 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Volume 45e6144e-c47d-499f-9658-d5c1db66241f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45e6144e-c47d-499f-9658-d5c1db66241f', 'volume_size': 1} Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:20 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870 1073741824" returned: 0 in 0.718s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:21 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870 Nov 04 19:07:21 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:21 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870" returned: 0 in 0.359s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.572s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-315804627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e6144e-c47d-499f-9658-d5c1db66241f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e06bd473564743b698ac5523d08c3fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:21Z,use_quota=True,user_id='6fc22b0379ef4e65ae31fdfa79981aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Creating volume 45e6144e-c47d-499f-9658-d5c1db66241f {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:21 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:21 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f 1073741824 Nov 04 19:07:21 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c16aa2c-7484-4a75-bf03-4e6e64c8889c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7809a5f8-487e-4869-8b08-ac6e2d72b870', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade46037-c6d5-41cb-9e56-b9aa3c8b4dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:21 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Volume volume-7809a5f8-487e-4869-8b08-ac6e2d72b870 (7809a5f8-487e-4869-8b08-ac6e2d72b870): created successfully Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade46037-c6d5-41cb-9e56-b9aa3c8b4dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Flow 'volume_create_manager' (2792e44f-e835-4d4b-9d5a-68e638a1c7c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Flow 'volume_create_manager' (73c7ca99-50f6-42dd-8b7a-babeea20e4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ee86c9-12b7-4056-a659-387e0fbb5c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ee86c9-12b7-4056-a659-387e0fbb5c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-160202005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55c7fe4b-dae1-4eaf-8c66-408013770e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a92b36959644800805f7a80103c44a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:21Z,use_quota=True,user_id='f76b1503007c432faf044eb9fa69079d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5accf1-e8f7-44b8-8546-9826b2bc57a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5accf1-e8f7-44b8-8546-9826b2bc57a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd3e9f8-3853-4e4b-af3f-8918a0bbb349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd3e9f8-3853-4e4b-af3f-8918a0bbb349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55c7fe4b-dae1-4eaf-8c66-408013770e8b', 'volume_name': 'volume-55c7fe4b-dae1-4eaf-8c66-408013770e8b', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12aa6cb-ae71-4852-90bc-070377469277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12aa6cb-ae71-4852-90bc-070377469277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac05543-9670-4cb7-b3d1-56fa5844ee68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:21 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Volume 55c7fe4b-dae1-4eaf-8c66-408013770e8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55c7fe4b-dae1-4eaf-8c66-408013770e8b', 'volume_size': 1} Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:21 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-d3931465-516e-4791-ac9a-2737b27cd8c2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Created volume successfully. Nov 04 19:07:21 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f 1073741824" returned: 0 in 0.535s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:21 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f Nov 04 19:07:21 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:22 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f" returned: 0 in 0.310s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:22 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.684s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:22 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-160202005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55c7fe4b-dae1-4eaf-8c66-408013770e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a92b36959644800805f7a80103c44a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:21Z,use_quota=True,user_id='f76b1503007c432faf044eb9fa69079d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:22 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Creating volume 55c7fe4b-dae1-4eaf-8c66-408013770e8b {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:22 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:22 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:22 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:22 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:07:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-55c7fe4b-dae1-4eaf-8c66-408013770e8b 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:22 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:UPDATE=275,cinder:SELECT=219,cinder:DELETE=22,cinder:INSERT=69 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:07:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b74b8325-f29a-4b5f-b1e9-282e5b909fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45e6144e-c47d-499f-9658-d5c1db66241f', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:22 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-55c7fe4b-dae1-4eaf-8c66-408013770e8b 1073741824 Nov 04 19:07:22 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ec5fb4-17e4-4018-9099-b5741c87caae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:22 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Volume volume-45e6144e-c47d-499f-9658-d5c1db66241f (45e6144e-c47d-499f-9658-d5c1db66241f): created successfully Nov 04 19:07:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ec5fb4-17e4-4018-9099-b5741c87caae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:22 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Flow 'volume_create_manager' (d7999f00-942f-477d-9677-630925e53a5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:22 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=204,cinder:UPDATE=291,cinder:INSERT=87,cinder:DELETE=27 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:07:22 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-53929a87-b3c8-4a40-9d26-ee7f340b436a tempest-ProjectReaderTests-421706438 None] Created volume successfully. Nov 04 19:07:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d2e6659a-a97f-4b2d-b2ad-e040fafb1ddd tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:22 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-55c7fe4b-dae1-4eaf-8c66-408013770e8b 1073741824" returned: 0 in 0.589s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-55c7fe4b-dae1-4eaf-8c66-408013770e8b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e6536b6e-ea1b-4e96-904a-f78b6211e2a1 tempest-ProjectReaderTests-421706438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:22 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-55c7fe4b-dae1-4eaf-8c66-408013770e8b Nov 04 19:07:22 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:23 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-55c7fe4b-dae1-4eaf-8c66-408013770e8b" returned: 0 in 0.248s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:23 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d2e6659a-a97f-4b2d-b2ad-e040fafb1ddd tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.673s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:23 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac05543-9670-4cb7-b3d1-56fa5844ee68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55c7fe4b-dae1-4eaf-8c66-408013770e8b', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:23 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc54568-cbbb-4d0c-8fd1-3816e5706424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:23 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-d2e6659a-a97f-4b2d-b2ad-e040fafb1ddd tempest-CreateVolumesFromSnapshotTest-340308143 None] Creating offline snapshot 6b3da420-cd2c-47d5-9bdd-a22024340a2d of volume 7809a5f8-487e-4869-8b08-ac6e2d72b870 {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:07:23 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Volume volume-55c7fe4b-dae1-4eaf-8c66-408013770e8b (55c7fe4b-dae1-4eaf-8c66-408013770e8b): created successfully Nov 04 19:07:23 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc54568-cbbb-4d0c-8fd1-3816e5706424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:23 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Flow 'volume_create_manager' (73c7ca99-50f6-42dd-8b7a-babeea20e4d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:23 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[99320431-c5ee-461b-90c1-929aff00832b]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d2e6659a-a97f-4b2d-b2ad-e040fafb1ddd tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:23 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-57f41d57-5e48-4a23-8eb6-08148f463d89 tempest-ProjectReaderTests-2137383739 None] Created volume successfully. Nov 04 19:07:23 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870 Nov 04 19:07:23 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:23 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d2e6659a-a97f-4b2d-b2ad-e040fafb1ddd tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870" returned: 0 in 0.410s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d2e6659a-a97f-4b2d-b2ad-e040fafb1ddd tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870.6b3da420-cd2c-47d5-9bdd-a22024340a2d 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:23 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870.6b3da420-cd2c-47d5-9bdd-a22024340a2d 1G Nov 04 19:07:23 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:23 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-36162f70-08bd-4d15-904a-c21032a82c31 tempest-ProjectReaderTests-2137383739 None] Acquiring lock "cinder-55c7fe4b-dae1-4eaf-8c66-408013770e8b-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:23 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-36162f70-08bd-4d15-904a-c21032a82c31 tempest-ProjectReaderTests-2137383739 None] Lock "cinder-55c7fe4b-dae1-4eaf-8c66-408013770e8b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:23 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-36162f70-08bd-4d15-904a-c21032a82c31 tempest-ProjectReaderTests-2137383739 None] Acquiring lock "cinder-quobyte-55c7fe4b-dae1-4eaf-8c66-408013770e8b" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:23 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-36162f70-08bd-4d15-904a-c21032a82c31 tempest-ProjectReaderTests-2137383739 None] Lock "cinder-quobyte-55c7fe4b-dae1-4eaf-8c66-408013770e8b" acquired by "delete_volume" :: waited 0.017s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:23 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a47b81f-d401-4a9e-a784-371a4613b126]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-36162f70-08bd-4d15-904a-c21032a82c31 tempest-ProjectReaderTests-2137383739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-55c7fe4b-dae1-4eaf-8c66-408013770e8b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:24 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-55c7fe4b-dae1-4eaf-8c66-408013770e8b Nov 04 19:07:24 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:24 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d2e6659a-a97f-4b2d-b2ad-e040fafb1ddd tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870.6b3da420-cd2c-47d5-9bdd-a22024340a2d 1G" returned: 0 in 0.490s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d2e6659a-a97f-4b2d-b2ad-e040fafb1ddd tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7809a5f8-487e-4869-8b08-ac6e2d72b870 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870.6b3da420-cd2c-47d5-9bdd-a22024340a2d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:24 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7809a5f8-487e-4869-8b08-ac6e2d72b870 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870.6b3da420-cd2c-47d5-9bdd-a22024340a2d Nov 04 19:07:24 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:24 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-36162f70-08bd-4d15-904a-c21032a82c31 tempest-ProjectReaderTests-2137383739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-55c7fe4b-dae1-4eaf-8c66-408013770e8b" returned: 0 in 0.387s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-36162f70-08bd-4d15-904a-c21032a82c31 tempest-ProjectReaderTests-2137383739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-55c7fe4b-dae1-4eaf-8c66-408013770e8b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:24 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-55c7fe4b-dae1-4eaf-8c66-408013770e8b Nov 04 19:07:24 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:24 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d2e6659a-a97f-4b2d-b2ad-e040fafb1ddd tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7809a5f8-487e-4869-8b08-ac6e2d72b870 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870.6b3da420-cd2c-47d5-9bdd-a22024340a2d" returned: 0 in 0.324s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:24 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-d2e6659a-a97f-4b2d-b2ad-e040fafb1ddd tempest-CreateVolumesFromSnapshotTest-340308143 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870.6b3da420-cd2c-47d5-9bdd-a22024340a2d is being set with open permissions: ugo+rw Nov 04 19:07:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d2e6659a-a97f-4b2d-b2ad-e040fafb1ddd tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870.6b3da420-cd2c-47d5-9bdd-a22024340a2d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:24 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870.6b3da420-cd2c-47d5-9bdd-a22024340a2d Nov 04 19:07:24 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:24 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-36162f70-08bd-4d15-904a-c21032a82c31 tempest-ProjectReaderTests-2137383739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-55c7fe4b-dae1-4eaf-8c66-408013770e8b" returned: 0 in 0.306s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:24 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-36162f70-08bd-4d15-904a-c21032a82c31 tempest-ProjectReaderTests-2137383739 None] Lock "cinder-quobyte-55c7fe4b-dae1-4eaf-8c66-408013770e8b" released by "delete_volume" :: held 0.742s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:24 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-36162f70-08bd-4d15-904a-c21032a82c31 tempest-ProjectReaderTests-2137383739 None] Created reservations ['561f2882-e50b-444b-9e45-40245ced6931', '5aa45c46-3ea3-43fc-ac25-dbe8ea69aa71', '587a1f9d-da5c-474e-bd9b-fc7d063648c2', '534b82bf-70e1-4fe3-acc6-630b624d5882'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:24 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d2e6659a-a97f-4b2d-b2ad-e040fafb1ddd tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870.6b3da420-cd2c-47d5-9bdd-a22024340a2d" returned: 0 in 0.302s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-36162f70-08bd-4d15-904a-c21032a82c31 tempest-ProjectReaderTests-2137383739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-36162f70-08bd-4d15-904a-c21032a82c31 tempest-ProjectReaderTests-2137383739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:24 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-36162f70-08bd-4d15-904a-c21032a82c31 tempest-ProjectReaderTests-2137383739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:24 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-36162f70-08bd-4d15-904a-c21032a82c31 tempest-ProjectReaderTests-2137383739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-36162f70-08bd-4d15-904a-c21032a82c31 tempest-ProjectReaderTests-2137383739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-36162f70-08bd-4d15-904a-c21032a82c31 tempest-ProjectReaderTests-2137383739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d2e6659a-a97f-4b2d-b2ad-e040fafb1ddd tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:24 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:07:24 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:24 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870.info Nov 04 19:07:24 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:25 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-36162f70-08bd-4d15-904a-c21032a82c31 tempest-ProjectReaderTests-2137383739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.265s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-36162f70-08bd-4d15-904a-c21032a82c31 tempest-ProjectReaderTests-2137383739 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:25 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-36162f70-08bd-4d15-904a-c21032a82c31 tempest-ProjectReaderTests-2137383739 None] Deleted volume successfully. Nov 04 19:07:25 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-36162f70-08bd-4d15-904a-c21032a82c31 tempest-ProjectReaderTests-2137383739 None] Lock "cinder-55c7fe4b-dae1-4eaf-8c66-408013770e8b-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d2e6659a-a97f-4b2d-b2ad-e040fafb1ddd tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870.info" returned: 0 in 0.297s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:25 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-d2e6659a-a97f-4b2d-b2ad-e040fafb1ddd tempest-CreateVolumesFromSnapshotTest-340308143 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870.info is being set with open permissions: ugo+rw Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d2e6659a-a97f-4b2d-b2ad-e040fafb1ddd tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:25 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870.info Nov 04 19:07:25 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:25 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d2e6659a-a97f-4b2d-b2ad-e040fafb1ddd tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870.info" returned: 0 in 0.266s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:25 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:07:25 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d2e6659a-a97f-4b2d-b2ad-e040fafb1ddd tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.236s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e6536b6e-ea1b-4e96-904a-f78b6211e2a1 tempest-ProjectReaderTests-421706438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.475s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-e6536b6e-ea1b-4e96-904a-f78b6211e2a1 tempest-ProjectReaderTests-421706438 None] Creating offline snapshot 2b72598d-008b-4a29-a0fa-cf2eb0bd23c2 of volume 45e6144e-c47d-499f-9658-d5c1db66241f {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:07:25 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-d2e6659a-a97f-4b2d-b2ad-e040fafb1ddd tempest-CreateVolumesFromSnapshotTest-340308143 None] Create snapshot completed successfully Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e009057-a9eb-4f6f-9ec0-9ca1746ac600]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e6536b6e-ea1b-4e96-904a-f78b6211e2a1 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Flow 'volume_create_manager' (7173d5d8-a4a8-4cdc-850b-6167835a7e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93319a7c-48e6-494d-aeb0-7d2e53905e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93319a7c-48e6-494d-aeb0-7d2e53905e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1743173185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff59f65b-d748-4f1d-88e9-8a25c12713a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a92b36959644800805f7a80103c44a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:25Z,use_quota=True,user_id='f76b1503007c432faf044eb9fa69079d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:25 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b35af1a-e30d-4116-b612-22fea89d9bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:25 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b35af1a-e30d-4116-b612-22fea89d9bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebfb4b08-8199-4825-9044-4056d6303b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebfb4b08-8199-4825-9044-4056d6303b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff59f65b-d748-4f1d-88e9-8a25c12713a1', 'volume_name': 'volume-ff59f65b-d748-4f1d-88e9-8a25c12713a1', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3bdd1f-ef60-4143-8709-7d9e99ff51d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3bdd1f-ef60-4143-8709-7d9e99ff51d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd685d7-b66d-4b17-b235-c5552394f68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:25 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Volume ff59f65b-d748-4f1d-88e9-8a25c12713a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff59f65b-d748-4f1d-88e9-8a25c12713a1', 'volume_size': 1} Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:25 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.287s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager._thread_info {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread count: 28 {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread info: [<_MainThread(MainThread, started 130247852032128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:07:25 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e6536b6e-ea1b-4e96-904a-f78b6211e2a1 tempest-ProjectReaderTests-421706438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f" returned: 0 in 0.398s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e6536b6e-ea1b-4e96-904a-f78b6211e2a1 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f.2b72598d-008b-4a29-a0fa-cf2eb0bd23c2 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:25 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f.2b72598d-008b-4a29-a0fa-cf2eb0bd23c2 1G Nov 04 19:07:25 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:26 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Flow 'volume_create_manager' (7a57f8d3-8940-409d-bef1-ff2cbea56936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fef58db-5e68-4a9b-b821-45c621fcfbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:26 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fef58db-5e68-4a9b-b821-45c621fcfbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-68534454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6133c48f-e6f1-40c9-9d23-8997604ca73b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcdf041f6194693b5254c8bec2846fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:26Z,use_quota=True,user_id='4341d1ecf43a43bfa1baf34455c76d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e72f798-0ec3-4de4-89e6-8b81fafbaf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e72f798-0ec3-4de4-89e6-8b81fafbaf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f4a615-36c0-4330-afe5-f1578ba3e11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f4a615-36c0-4330-afe5-f1578ba3e11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6133c48f-e6f1-40c9-9d23-8997604ca73b', 'volume_name': 'volume-6133c48f-e6f1-40c9-9d23-8997604ca73b', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1dfbc66-4324-4200-9448-6dfdb4bfb746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1dfbc66-4324-4200-9448-6dfdb4bfb746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (508b554e-7c38-4a5f-bb3c-cfbff1925c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:26 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Volume 6133c48f-e6f1-40c9-9d23-8997604ca73b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6133c48f-e6f1-40c9-9d23-8997604ca73b', 'volume_size': 1} Nov 04 19:07:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e6536b6e-ea1b-4e96-904a-f78b6211e2a1 tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f.2b72598d-008b-4a29-a0fa-cf2eb0bd23c2 1G" returned: 0 in 0.626s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e6536b6e-ea1b-4e96-904a-f78b6211e2a1 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45e6144e-c47d-499f-9658-d5c1db66241f -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f.2b72598d-008b-4a29-a0fa-cf2eb0bd23c2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:26 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45e6144e-c47d-499f-9658-d5c1db66241f -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f.2b72598d-008b-4a29-a0fa-cf2eb0bd23c2 Nov 04 19:07:26 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:26 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Flow 'volume_create_manager' (bd03352e-edf6-4671-941b-cc8ab4626d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48da0674-db62-4df6-96e6-242866ef1c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48da0674-db62-4df6-96e6-242866ef1c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-384370705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=447a6481-d0d4-4ada-bf0b-ac0e866b3fcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcdf041f6194693b5254c8bec2846fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:27Z,use_quota=True,user_id='4341d1ecf43a43bfa1baf34455c76d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2122e95-32cd-4d48-af7b-5e90ab59c485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2122e95-32cd-4d48-af7b-5e90ab59c485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ca8176-9c09-4e53-9b30-6c52a678cfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ca8176-9c09-4e53-9b30-6c52a678cfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '447a6481-d0d4-4ada-bf0b-ac0e866b3fcc', 'volume_name': 'volume-447a6481-d0d4-4ada-bf0b-ac0e866b3fcc', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fdce8cd-e0d4-4182-8786-dd82bdc924e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fdce8cd-e0d4-4182-8786-dd82bdc924e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:26 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a93d33a9-b5a8-48b5-87f0-dc1c3a743507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:26 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Volume 447a6481-d0d4-4ada-bf0b-ac0e866b3fcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-447a6481-d0d4-4ada-bf0b-ac0e866b3fcc', 'volume_size': 1} Nov 04 19:07:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:26 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e6536b6e-ea1b-4e96-904a-f78b6211e2a1 tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45e6144e-c47d-499f-9658-d5c1db66241f -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f.2b72598d-008b-4a29-a0fa-cf2eb0bd23c2" returned: 0 in 0.455s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:26 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-e6536b6e-ea1b-4e96-904a-f78b6211e2a1 tempest-ProjectReaderTests-421706438 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f.2b72598d-008b-4a29-a0fa-cf2eb0bd23c2 is being set with open permissions: ugo+rw Nov 04 19:07:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e6536b6e-ea1b-4e96-904a-f78b6211e2a1 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f.2b72598d-008b-4a29-a0fa-cf2eb0bd23c2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:27 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f.2b72598d-008b-4a29-a0fa-cf2eb0bd23c2 Nov 04 19:07:27 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:27 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Flow 'volume_create_manager' (73a0acf7-9d30-45a2-bfc6-cc275951bad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbcfae5b-fafe-42f5-a071-53a41b891f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbcfae5b-fafe-42f5-a071-53a41b891f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-657324016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a1b716b-cffc-4e29-a53f-1c0ff0615022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcdf041f6194693b5254c8bec2846fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:27Z,use_quota=True,user_id='4341d1ecf43a43bfa1baf34455c76d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391b84b7-3967-40f7-b278-52756953dfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391b84b7-3967-40f7-b278-52756953dfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036313ee-a6a5-4652-af15-6f2ff632d090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036313ee-a6a5-4652-af15-6f2ff632d090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a1b716b-cffc-4e29-a53f-1c0ff0615022', 'volume_name': 'volume-3a1b716b-cffc-4e29-a53f-1c0ff0615022', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7740d3c-8755-4ea0-8f54-a0a0c56597cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7740d3c-8755-4ea0-8f54-a0a0c56597cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a05e229d-c72a-4e7d-9040-e9a29741d36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:27 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Volume 3a1b716b-cffc-4e29-a53f-1c0ff0615022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a1b716b-cffc-4e29-a53f-1c0ff0615022', 'volume_size': 1} Nov 04 19:07:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:27 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e6536b6e-ea1b-4e96-904a-f78b6211e2a1 tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f.2b72598d-008b-4a29-a0fa-cf2eb0bd23c2" returned: 0 in 0.340s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e6536b6e-ea1b-4e96-904a-f78b6211e2a1 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:27 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f.info Nov 04 19:07:27 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:27 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Flow 'volume_create_manager' (83c29de1-a2d1-43ae-9e48-027fb1e140c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec29e71-5d01-45c4-aeca-99ddbf36e584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec29e71-5d01-45c4-aeca-99ddbf36e584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-753320562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f743e9-5ddb-43f6-9ac9-04510db24739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcdf041f6194693b5254c8bec2846fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:28Z,use_quota=True,user_id='4341d1ecf43a43bfa1baf34455c76d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a226da6f-a317-42a9-979e-e2b08238cf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a226da6f-a317-42a9-979e-e2b08238cf56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (501093ed-0960-40e4-9e42-4e3944f47f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:27 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (501093ed-0960-40e4-9e42-4e3944f47f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5f743e9-5ddb-43f6-9ac9-04510db24739', 'volume_name': 'volume-c5f743e9-5ddb-43f6-9ac9-04510db24739', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdaf11f-537c-4154-8d26-510bc4140d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdaf11f-537c-4154-8d26-510bc4140d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:27 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6632fb8-6e21-4244-bfff-859d498ff842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:27 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Volume c5f743e9-5ddb-43f6-9ac9-04510db24739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5f743e9-5ddb-43f6-9ac9-04510db24739', 'volume_size': 1} Nov 04 19:07:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e6536b6e-ea1b-4e96-904a-f78b6211e2a1 tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f.info" returned: 0 in 0.382s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:27 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-e6536b6e-ea1b-4e96-904a-f78b6211e2a1 tempest-ProjectReaderTests-421706438 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f.info is being set with open permissions: ugo+rw Nov 04 19:07:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e6536b6e-ea1b-4e96-904a-f78b6211e2a1 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:27 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f.info Nov 04 19:07:27 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:28 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e6536b6e-ea1b-4e96-904a-f78b6211e2a1 tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f.info" returned: 0 in 0.287s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e6536b6e-ea1b-4e96-904a-f78b6211e2a1 tempest-ProjectReaderTests-421706438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.613s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.412s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1743173185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff59f65b-d748-4f1d-88e9-8a25c12713a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a92b36959644800805f7a80103c44a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:25Z,use_quota=True,user_id='f76b1503007c432faf044eb9fa69079d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Creating volume ff59f65b-d748-4f1d-88e9-8a25c12713a1 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:28 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ff59f65b-d748-4f1d-88e9-8a25c12713a1 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:28 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ff59f65b-d748-4f1d-88e9-8a25c12713a1 1073741824 Nov 04 19:07:28 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:28 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e6536b6e-ea1b-4e96-904a-f78b6211e2a1 tempest-ProjectReaderTests-421706438 None] Create snapshot completed successfully Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Flow 'volume_create_manager' (d1746eeb-9441-45b1-965d-0fab8d70aa0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb33cf61-f1b1-4886-835d-c11045d4ea08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb33cf61-f1b1-4886-835d-c11045d4ea08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-744862179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0fb3767-8e88-4146-9b9b-ee285443c000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcdf041f6194693b5254c8bec2846fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:28Z,use_quota=True,user_id='4341d1ecf43a43bfa1baf34455c76d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b40bc19-2f23-4161-9cb7-4355ee75efb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b40bc19-2f23-4161-9cb7-4355ee75efb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1963393-bcb1-4b6a-ab2f-c288ed93b207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1963393-bcb1-4b6a-ab2f-c288ed93b207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0fb3767-8e88-4146-9b9b-ee285443c000', 'volume_name': 'volume-f0fb3767-8e88-4146-9b9b-ee285443c000', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f1ed5e-7f63-47ed-b9a0-1b9937970756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f1ed5e-7f63-47ed-b9a0-1b9937970756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e89f71-d62b-40f3-8447-1433d7f44748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:28 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Volume f0fb3767-8e88-4146-9b9b-ee285443c000: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0fb3767-8e88-4146-9b9b-ee285443c000', 'volume_size': 1} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-56653734-3dbc-45c9-acda-a899c4f97ff3 tempest-ProjectReaderTests-421706438 None] Acquiring lock "cinder-2b72598d-008b-4a29-a0fa-cf2eb0bd23c2-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-56653734-3dbc-45c9-acda-a899c4f97ff3 tempest-ProjectReaderTests-421706438 None] Lock "cinder-2b72598d-008b-4a29-a0fa-cf2eb0bd23c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-56653734-3dbc-45c9-acda-a899c4f97ff3 tempest-ProjectReaderTests-421706438 None] Acquiring lock "cinder-quobyte-45e6144e-c47d-499f-9658-d5c1db66241f" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-56653734-3dbc-45c9-acda-a899c4f97ff3 tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-45e6144e-c47d-499f-9658-d5c1db66241f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-56653734-3dbc-45c9-acda-a899c4f97ff3 tempest-ProjectReaderTests-421706438 None] Acquiring lock "cinder-quobyte-2b72598d-008b-4a29-a0fa-cf2eb0bd23c2" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-56653734-3dbc-45c9-acda-a899c4f97ff3 tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-2b72598d-008b-4a29-a0fa-cf2eb0bd23c2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-56653734-3dbc-45c9-acda-a899c4f97ff3 tempest-ProjectReaderTests-421706438 None] Deleting offline snapshot 2b72598d-008b-4a29-a0fa-cf2eb0bd23c2 of volume 45e6144e-c47d-499f-9658-d5c1db66241f {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-56653734-3dbc-45c9-acda-a899c4f97ff3 tempest-ProjectReaderTests-421706438 None] snapshot_file for this snap is: volume-45e6144e-c47d-499f-9658-d5c1db66241f.2b72598d-008b-4a29-a0fa-cf2eb0bd23c2 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a5a19b-a9b9-47d6-a66f-bd89b99d47aa]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-56653734-3dbc-45c9-acda-a899c4f97ff3 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f.2b72598d-008b-4a29-a0fa-cf2eb0bd23c2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:28 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f.2b72598d-008b-4a29-a0fa-cf2eb0bd23c2 Nov 04 19:07:28 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:28 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ff59f65b-d748-4f1d-88e9-8a25c12713a1 1073741824" returned: 0 in 0.534s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ff59f65b-d748-4f1d-88e9-8a25c12713a1 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:28 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ff59f65b-d748-4f1d-88e9-8a25c12713a1 Nov 04 19:07:28 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:28 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-56653734-3dbc-45c9-acda-a899c4f97ff3 tempest-ProjectReaderTests-421706438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f.2b72598d-008b-4a29-a0fa-cf2eb0bd23c2" returned: 0 in 0.400s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-56653734-3dbc-45c9-acda-a899c4f97ff3 tempest-ProjectReaderTests-421706438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45e6144e-c47d-499f-9658-d5c1db66241f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa466b9-f1d6-4d63-93b1-29b0310c85fb]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-56653734-3dbc-45c9-acda-a899c4f97ff3 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:28 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ff59f65b-d748-4f1d-88e9-8a25c12713a1" returned: 0 in 0.270s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.397s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-68534454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6133c48f-e6f1-40c9-9d23-8997604ca73b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcdf041f6194693b5254c8bec2846fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:26Z,use_quota=True,user_id='4341d1ecf43a43bfa1baf34455c76d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Creating volume 6133c48f-e6f1-40c9-9d23-8997604ca73b {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:28 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6133c48f-e6f1-40c9-9d23-8997604ca73b 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd685d7-b66d-4b17-b235-c5552394f68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff59f65b-d748-4f1d-88e9-8a25c12713a1', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303dd032-f154-497e-8547-ebc9657e309a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:28 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6133c48f-e6f1-40c9-9d23-8997604ca73b 1073741824 Nov 04 19:07:28 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:28 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Volume volume-ff59f65b-d748-4f1d-88e9-8a25c12713a1 (ff59f65b-d748-4f1d-88e9-8a25c12713a1): created successfully Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303dd032-f154-497e-8547-ebc9657e309a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Flow 'volume_create_manager' (7173d5d8-a4a8-4cdc-850b-6167835a7e7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:29 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-acc9af7a-2cac-4187-bf26-1d9ae60d0d65 tempest-ProjectReaderTests-2137383739 None] Created volume successfully. Nov 04 19:07:29 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f Nov 04 19:07:29 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:29 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-56653734-3dbc-45c9-acda-a899c4f97ff3 tempest-ProjectReaderTests-421706438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f" returned: 0 in 0.415s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-56653734-3dbc-45c9-acda-a899c4f97ff3 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f.2b72598d-008b-4a29-a0fa-cf2eb0bd23c2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:29 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f.2b72598d-008b-4a29-a0fa-cf2eb0bd23c2 Nov 04 19:07:29 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:29 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6133c48f-e6f1-40c9-9d23-8997604ca73b 1073741824" returned: 0 in 0.510s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6133c48f-e6f1-40c9-9d23-8997604ca73b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:29 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6133c48f-e6f1-40c9-9d23-8997604ca73b Nov 04 19:07:29 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:29 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-56653734-3dbc-45c9-acda-a899c4f97ff3 tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f.2b72598d-008b-4a29-a0fa-cf2eb0bd23c2" returned: 0 in 0.377s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-56653734-3dbc-45c9-acda-a899c4f97ff3 tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f.2b72598d-008b-4a29-a0fa-cf2eb0bd23c2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:29 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f.2b72598d-008b-4a29-a0fa-cf2eb0bd23c2 Nov 04 19:07:29 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:29 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6133c48f-e6f1-40c9-9d23-8997604ca73b" returned: 0 in 0.268s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.841s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-384370705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=447a6481-d0d4-4ada-bf0b-ac0e866b3fcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcdf041f6194693b5254c8bec2846fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:27Z,use_quota=True,user_id='4341d1ecf43a43bfa1baf34455c76d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Creating volume 447a6481-d0d4-4ada-bf0b-ac0e866b3fcc {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:29 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:07:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-447a6481-d0d4-4ada-bf0b-ac0e866b3fcc 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:29 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-447a6481-d0d4-4ada-bf0b-ac0e866b3fcc 1073741824 Nov 04 19:07:29 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (508b554e-7c38-4a5f-bb3c-cfbff1925c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6133c48f-e6f1-40c9-9d23-8997604ca73b', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5298f0-4e96-4e9f-b440-519c7a74c30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:29 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Volume volume-6133c48f-e6f1-40c9-9d23-8997604ca73b (6133c48f-e6f1-40c9-9d23-8997604ca73b): created successfully Nov 04 19:07:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5298f0-4e96-4e9f-b440-519c7a74c30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Flow 'volume_create_manager' (7a57f8d3-8940-409d-bef1-ff2cbea56936) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:29 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-ddfbdba2-aeb6-45e9-9bd7-1f4bc78f6c94 tempest-CreateVolumesFromSnapshotTest-340308143 None] Created volume successfully. Nov 04 19:07:29 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-56653734-3dbc-45c9-acda-a899c4f97ff3 tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f.2b72598d-008b-4a29-a0fa-cf2eb0bd23c2" returned: 0 in 0.301s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a6054e04-fe40-43f2-83e4-9606b8d9f62a tempest-ProjectReaderTests-2137383739 None] Acquiring lock "cinder-ff59f65b-d748-4f1d-88e9-8a25c12713a1-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-56653734-3dbc-45c9-acda-a899c4f97ff3 tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-2b72598d-008b-4a29-a0fa-cf2eb0bd23c2" released by "_delete_snapshot" :: held 1.652s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-56653734-3dbc-45c9-acda-a899c4f97ff3 tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-45e6144e-c47d-499f-9658-d5c1db66241f" released by "delete_snapshot" :: held 1.688s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a6054e04-fe40-43f2-83e4-9606b8d9f62a tempest-ProjectReaderTests-2137383739 None] Lock "cinder-ff59f65b-d748-4f1d-88e9-8a25c12713a1-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a6054e04-fe40-43f2-83e4-9606b8d9f62a tempest-ProjectReaderTests-2137383739 None] Acquiring lock "cinder-quobyte-ff59f65b-d748-4f1d-88e9-8a25c12713a1" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a6054e04-fe40-43f2-83e4-9606b8d9f62a tempest-ProjectReaderTests-2137383739 None] Lock "cinder-quobyte-ff59f65b-d748-4f1d-88e9-8a25c12713a1" acquired by "delete_volume" :: waited 0.030s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[150404b8-3cc9-4109-9621-0e6de6e4bf61]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a6054e04-fe40-43f2-83e4-9606b8d9f62a tempest-ProjectReaderTests-2137383739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ff59f65b-d748-4f1d-88e9-8a25c12713a1 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-56653734-3dbc-45c9-acda-a899c4f97ff3 tempest-ProjectReaderTests-421706438 None] Created reservations ['94f6bbae-2bbf-4401-8eae-387d4e4c41a6', '898ff62a-32f5-452b-b75e-1351a91c9857', '12986f8a-fe23-4652-9b48-f08c71b8750d', '5df8c5e4-81a4-4cfa-9036-5f3a7f592385'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:30 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-56653734-3dbc-45c9-acda-a899c4f97ff3 tempest-ProjectReaderTests-421706438 None] Delete snapshot completed successfully. Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-56653734-3dbc-45c9-acda-a899c4f97ff3 tempest-ProjectReaderTests-421706438 None] Lock "cinder-2b72598d-008b-4a29-a0fa-cf2eb0bd23c2-delete_snapshot" released by "delete_snapshot" :: held 1.961s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:30 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ff59f65b-d748-4f1d-88e9-8a25c12713a1 Nov 04 19:07:30 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:30 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-447a6481-d0d4-4ada-bf0b-ac0e866b3fcc 1073741824" returned: 0 in 0.600s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-447a6481-d0d4-4ada-bf0b-ac0e866b3fcc {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:30 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-447a6481-d0d4-4ada-bf0b-ac0e866b3fcc Nov 04 19:07:30 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6b0ee90e-2075-48dc-8bac-51a4d7719f6d tempest-ProjectReaderTests-421706438 None] Acquiring lock "cinder-45e6144e-c47d-499f-9658-d5c1db66241f-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6b0ee90e-2075-48dc-8bac-51a4d7719f6d tempest-ProjectReaderTests-421706438 None] Lock "cinder-45e6144e-c47d-499f-9658-d5c1db66241f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6b0ee90e-2075-48dc-8bac-51a4d7719f6d tempest-ProjectReaderTests-421706438 None] Acquiring lock "cinder-quobyte-45e6144e-c47d-499f-9658-d5c1db66241f" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6b0ee90e-2075-48dc-8bac-51a4d7719f6d tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-45e6144e-c47d-499f-9658-d5c1db66241f" acquired by "delete_volume" :: waited 0.025s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fe78c5-3b62-4b50-a004-c93ffc930922]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6b0ee90e-2075-48dc-8bac-51a4d7719f6d tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:30 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a6054e04-fe40-43f2-83e4-9606b8d9f62a tempest-ProjectReaderTests-2137383739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ff59f65b-d748-4f1d-88e9-8a25c12713a1" returned: 0 in 0.483s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a6054e04-fe40-43f2-83e4-9606b8d9f62a tempest-ProjectReaderTests-2137383739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ff59f65b-d748-4f1d-88e9-8a25c12713a1 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:30 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ff59f65b-d748-4f1d-88e9-8a25c12713a1 Nov 04 19:07:30 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:30 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-447a6481-d0d4-4ada-bf0b-ac0e866b3fcc" returned: 0 in 0.341s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.488s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-657324016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a1b716b-cffc-4e29-a53f-1c0ff0615022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcdf041f6194693b5254c8bec2846fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:27Z,use_quota=True,user_id='4341d1ecf43a43bfa1baf34455c76d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Creating volume 3a1b716b-cffc-4e29-a53f-1c0ff0615022 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:30 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a1b716b-cffc-4e29-a53f-1c0ff0615022 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a93d33a9-b5a8-48b5-87f0-dc1c3a743507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-447a6481-d0d4-4ada-bf0b-ac0e866b3fcc', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:30 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a1b716b-cffc-4e29-a53f-1c0ff0615022 1073741824 Nov 04 19:07:30 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c20634e-a5e2-4bb7-883d-d605d73b4b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:30 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f Nov 04 19:07:30 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:30 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Volume volume-447a6481-d0d4-4ada-bf0b-ac0e866b3fcc (447a6481-d0d4-4ada-bf0b-ac0e866b3fcc): created successfully Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c20634e-a5e2-4bb7-883d-d605d73b4b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:30 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Flow 'volume_create_manager' (bd03352e-edf6-4671-941b-cc8ab4626d1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:30 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-3ad39674-62ea-4052-9d9e-3ac05b1df846 tempest-CreateVolumesFromSnapshotTest-340308143 None] Created volume successfully. Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Flow 'volume_create_manager' (7ea98dd9-02f5-4040-8749-e359a8f05cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eaa255c-95a7-43cd-8c06-8477af0392ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:31 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a6054e04-fe40-43f2-83e4-9606b8d9f62a tempest-ProjectReaderTests-2137383739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ff59f65b-d748-4f1d-88e9-8a25c12713a1" returned: 0 in 0.427s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:31 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eaa255c-95a7-43cd-8c06-8477af0392ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1229885161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc522ed-a7ca-4efa-86d6-6c99997f1e6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d3eb206cad94084a5c6283e2ff66444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:31Z,use_quota=True,user_id='ddf65909617d4434b557a176d0457659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f9d7e7d-ce15-458f-819a-04e61c871783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f9d7e7d-ce15-458f-819a-04e61c871783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b7ce06-6be4-431a-a94f-0745b5d5dca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b7ce06-6be4-431a-a94f-0745b5d5dca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adc522ed-a7ca-4efa-86d6-6c99997f1e6e', 'volume_name': 'volume-adc522ed-a7ca-4efa-86d6-6c99997f1e6e', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e682baf-da20-419e-bdf2-3c8d3753c4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e682baf-da20-419e-bdf2-3c8d3753c4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871fc10c-e67b-4620-ab5d-57b37064298a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:31 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Volume adc522ed-a7ca-4efa-86d6-6c99997f1e6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adc522ed-a7ca-4efa-86d6-6c99997f1e6e', 'volume_size': 1} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6b0ee90e-2075-48dc-8bac-51a4d7719f6d tempest-ProjectReaderTests-421706438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f" returned: 0 in 0.514s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6b0ee90e-2075-48dc-8bac-51a4d7719f6d tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a6054e04-fe40-43f2-83e4-9606b8d9f62a tempest-ProjectReaderTests-2137383739 None] Lock "cinder-quobyte-ff59f65b-d748-4f1d-88e9-8a25c12713a1" released by "delete_volume" :: held 1.017s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:31 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f Nov 04 19:07:31 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-a6054e04-fe40-43f2-83e4-9606b8d9f62a tempest-ProjectReaderTests-2137383739 None] Created reservations ['8b7b6ead-77ca-4756-a229-dcb20ad1abec', '24e6a7f9-e040-4e9e-a673-ca661aa9e740', '0c4b9373-839d-409b-aad4-f6d60c43231c', 'c4d2a650-5c32-49c5-97e8-75239abc3c81'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:31 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a1b716b-cffc-4e29-a53f-1c0ff0615022 1073741824" returned: 0 in 0.574s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a6054e04-fe40-43f2-83e4-9606b8d9f62a tempest-ProjectReaderTests-2137383739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a6054e04-fe40-43f2-83e4-9606b8d9f62a tempest-ProjectReaderTests-2137383739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a6054e04-fe40-43f2-83e4-9606b8d9f62a tempest-ProjectReaderTests-2137383739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-a6054e04-fe40-43f2-83e4-9606b8d9f62a tempest-ProjectReaderTests-2137383739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-a6054e04-fe40-43f2-83e4-9606b8d9f62a tempest-ProjectReaderTests-2137383739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a6054e04-fe40-43f2-83e4-9606b8d9f62a tempest-ProjectReaderTests-2137383739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:31 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:07:31 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a1b716b-cffc-4e29-a53f-1c0ff0615022 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:31 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a1b716b-cffc-4e29-a53f-1c0ff0615022 Nov 04 19:07:31 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:31 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6b0ee90e-2075-48dc-8bac-51a4d7719f6d tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-45e6144e-c47d-499f-9658-d5c1db66241f" returned: 0 in 0.286s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6b0ee90e-2075-48dc-8bac-51a4d7719f6d tempest-ProjectReaderTests-421706438 None] Lock "cinder-quobyte-45e6144e-c47d-499f-9658-d5c1db66241f" released by "delete_volume" :: held 0.871s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-6b0ee90e-2075-48dc-8bac-51a4d7719f6d tempest-ProjectReaderTests-421706438 None] Created reservations ['f502a0fd-356d-4245-b719-cfc30129dd92', '839b9c4d-9534-427e-8a58-6ad6e83f4715', '01c296fb-b010-48b9-9918-780351aecbfd', 'dc8b2b7a-7474-4a62-8664-10090de2481d'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6b0ee90e-2075-48dc-8bac-51a4d7719f6d tempest-ProjectReaderTests-421706438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6b0ee90e-2075-48dc-8bac-51a4d7719f6d tempest-ProjectReaderTests-421706438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-6b0ee90e-2075-48dc-8bac-51a4d7719f6d tempest-ProjectReaderTests-421706438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-6b0ee90e-2075-48dc-8bac-51a4d7719f6d tempest-ProjectReaderTests-421706438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6b0ee90e-2075-48dc-8bac-51a4d7719f6d tempest-ProjectReaderTests-421706438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6b0ee90e-2075-48dc-8bac-51a4d7719f6d tempest-ProjectReaderTests-421706438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:31 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:07:31 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:31 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a6054e04-fe40-43f2-83e4-9606b8d9f62a tempest-ProjectReaderTests-2137383739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.311s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-a6054e04-fe40-43f2-83e4-9606b8d9f62a tempest-ProjectReaderTests-2137383739 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:31 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-a6054e04-fe40-43f2-83e4-9606b8d9f62a tempest-ProjectReaderTests-2137383739 None] Deleted volume successfully. Nov 04 19:07:31 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a1b716b-cffc-4e29-a53f-1c0ff0615022" returned: 0 in 0.295s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.965s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-753320562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f743e9-5ddb-43f6-9ac9-04510db24739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcdf041f6194693b5254c8bec2846fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:28Z,use_quota=True,user_id='4341d1ecf43a43bfa1baf34455c76d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Creating volume c5f743e9-5ddb-43f6-9ac9-04510db24739 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:31 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c5f743e9-5ddb-43f6-9ac9-04510db24739 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a6054e04-fe40-43f2-83e4-9606b8d9f62a tempest-ProjectReaderTests-2137383739 None] Lock "cinder-ff59f65b-d748-4f1d-88e9-8a25c12713a1-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a05e229d-c72a-4e7d-9040-e9a29741d36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a1b716b-cffc-4e29-a53f-1c0ff0615022', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:31 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c5f743e9-5ddb-43f6-9ac9-04510db24739 1073741824 Nov 04 19:07:31 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff113f5f-59f4-432c-9825-a905fb630799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:31 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Volume volume-3a1b716b-cffc-4e29-a53f-1c0ff0615022 (3a1b716b-cffc-4e29-a53f-1c0ff0615022): created successfully Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff113f5f-59f4-432c-9825-a905fb630799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Flow 'volume_create_manager' (73a0acf7-9d30-45a2-bfc6-cc275951bad3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:31 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-084d5912-7139-4a17-8577-0c25840508ed tempest-CreateVolumesFromSnapshotTest-340308143 None] Created volume successfully. Nov 04 19:07:31 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6b0ee90e-2075-48dc-8bac-51a4d7719f6d tempest-ProjectReaderTests-421706438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.290s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-6b0ee90e-2075-48dc-8bac-51a4d7719f6d tempest-ProjectReaderTests-421706438 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:31 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-6b0ee90e-2075-48dc-8bac-51a4d7719f6d tempest-ProjectReaderTests-421706438 None] Deleted volume successfully. Nov 04 19:07:31 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-6b0ee90e-2075-48dc-8bac-51a4d7719f6d tempest-ProjectReaderTests-421706438 None] Lock "cinder-45e6144e-c47d-499f-9658-d5c1db66241f-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:32 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c5f743e9-5ddb-43f6-9ac9-04510db24739 1073741824" returned: 0 in 0.556s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c5f743e9-5ddb-43f6-9ac9-04510db24739 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:32 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c5f743e9-5ddb-43f6-9ac9-04510db24739 Nov 04 19:07:32 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:32 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c5f743e9-5ddb-43f6-9ac9-04510db24739" returned: 0 in 0.285s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.354s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-744862179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0fb3767-8e88-4146-9b9b-ee285443c000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcdf041f6194693b5254c8bec2846fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:28Z,use_quota=True,user_id='4341d1ecf43a43bfa1baf34455c76d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Creating volume f0fb3767-8e88-4146-9b9b-ee285443c000 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:32 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f0fb3767-8e88-4146-9b9b-ee285443c000 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:32 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f0fb3767-8e88-4146-9b9b-ee285443c000 1073741824 Nov 04 19:07:32 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6632fb8-6e21-4244-bfff-859d498ff842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5f743e9-5ddb-43f6-9ac9-04510db24739', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78201a55-b5a1-4e00-9593-10995431fa4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:32 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Volume volume-c5f743e9-5ddb-43f6-9ac9-04510db24739 (c5f743e9-5ddb-43f6-9ac9-04510db24739): created successfully Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78201a55-b5a1-4e00-9593-10995431fa4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Flow 'volume_create_manager' (83c29de1-a2d1-43ae-9e48-027fb1e140c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:32 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-513f9de2-e6ed-47a6-95ce-b202d55de597 tempest-CreateVolumesFromSnapshotTest-340308143 None] Created volume successfully. Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Flow 'volume_create_manager' (598f7163-11d2-41c3-a02c-51647b167a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5293b73b-b61d-490c-9cb4-7fdaac0cf34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5293b73b-b61d-490c-9cb4-7fdaac0cf34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-258208223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aeac9db-750a-4ede-9748-7050883e5a53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a92b36959644800805f7a80103c44a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:33Z,use_quota=True,user_id='f76b1503007c432faf044eb9fa69079d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (820f42e4-bc1d-450e-aac0-0cb59a754fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (820f42e4-bc1d-450e-aac0-0cb59a754fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1262781f-ea7d-4705-b962-1ee974060b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1262781f-ea7d-4705-b962-1ee974060b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aeac9db-750a-4ede-9748-7050883e5a53', 'volume_name': 'volume-1aeac9db-750a-4ede-9748-7050883e5a53', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02365325-1254-4d76-99ce-4cc07b842343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02365325-1254-4d76-99ce-4cc07b842343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deab666a-1262-4950-ad5d-8b11d9d3646a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:32 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Volume 1aeac9db-750a-4ede-9748-7050883e5a53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aeac9db-750a-4ede-9748-7050883e5a53', 'volume_size': 1} Nov 04 19:07:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:33 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f0fb3767-8e88-4146-9b9b-ee285443c000 1073741824" returned: 0 in 0.492s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f0fb3767-8e88-4146-9b9b-ee285443c000 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:33 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f0fb3767-8e88-4146-9b9b-ee285443c000 Nov 04 19:07:33 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:33 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f0fb3767-8e88-4146-9b9b-ee285443c000" returned: 0 in 0.251s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.231s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1229885161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc522ed-a7ca-4efa-86d6-6c99997f1e6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d3eb206cad94084a5c6283e2ff66444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:31Z,use_quota=True,user_id='ddf65909617d4434b557a176d0457659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Creating volume adc522ed-a7ca-4efa-86d6-6c99997f1e6e {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:33 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:07:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-adc522ed-a7ca-4efa-86d6-6c99997f1e6e 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e89f71-d62b-40f3-8447-1433d7f44748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0fb3767-8e88-4146-9b9b-ee285443c000', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a243701-7eff-4c37-9f6d-abbacb837401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:33 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-adc522ed-a7ca-4efa-86d6-6c99997f1e6e 1073741824 Nov 04 19:07:33 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:33 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Volume volume-f0fb3767-8e88-4146-9b9b-ee285443c000 (f0fb3767-8e88-4146-9b9b-ee285443c000): created successfully Nov 04 19:07:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a243701-7eff-4c37-9f6d-abbacb837401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Flow 'volume_create_manager' (d1746eeb-9441-45b1-965d-0fab8d70aa0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:33 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-118f3f9c-8a88-4df7-842d-13d7ba11f2c4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Created volume successfully. Nov 04 19:07:33 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d058797e-ee12-4542-b0ee-4f1f94fd4285 tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "cinder-f0fb3767-8e88-4146-9b9b-ee285443c000-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:33 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d058797e-ee12-4542-b0ee-4f1f94fd4285 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-f0fb3767-8e88-4146-9b9b-ee285443c000-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:33 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d058797e-ee12-4542-b0ee-4f1f94fd4285 tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "cinder-quobyte-f0fb3767-8e88-4146-9b9b-ee285443c000" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:33 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d058797e-ee12-4542-b0ee-4f1f94fd4285 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-quobyte-f0fb3767-8e88-4146-9b9b-ee285443c000" acquired by "delete_volume" :: waited 0.020s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:33 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dcd026-7b88-4e12-bbb0-4b63adc7422f]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d058797e-ee12-4542-b0ee-4f1f94fd4285 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f0fb3767-8e88-4146-9b9b-ee285443c000 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:33 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f0fb3767-8e88-4146-9b9b-ee285443c000 Nov 04 19:07:33 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:33 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-adc522ed-a7ca-4efa-86d6-6c99997f1e6e 1073741824" returned: 0 in 0.577s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-adc522ed-a7ca-4efa-86d6-6c99997f1e6e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:34 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-adc522ed-a7ca-4efa-86d6-6c99997f1e6e Nov 04 19:07:34 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:34 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d058797e-ee12-4542-b0ee-4f1f94fd4285 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f0fb3767-8e88-4146-9b9b-ee285443c000" returned: 0 in 0.402s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d058797e-ee12-4542-b0ee-4f1f94fd4285 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f0fb3767-8e88-4146-9b9b-ee285443c000 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:34 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f0fb3767-8e88-4146-9b9b-ee285443c000 Nov 04 19:07:34 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:34 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-adc522ed-a7ca-4efa-86d6-6c99997f1e6e" returned: 0 in 0.272s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.404s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-258208223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aeac9db-750a-4ede-9748-7050883e5a53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a92b36959644800805f7a80103c44a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:33Z,use_quota=True,user_id='f76b1503007c432faf044eb9fa69079d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Creating volume 1aeac9db-750a-4ede-9748-7050883e5a53 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:34 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1aeac9db-750a-4ede-9748-7050883e5a53 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871fc10c-e67b-4620-ab5d-57b37064298a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adc522ed-a7ca-4efa-86d6-6c99997f1e6e', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:34 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1aeac9db-750a-4ede-9748-7050883e5a53 1073741824 Nov 04 19:07:34 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (382de9c2-6cff-4b54-bf8a-abd794b662c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:34 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Volume volume-adc522ed-a7ca-4efa-86d6-6c99997f1e6e (adc522ed-a7ca-4efa-86d6-6c99997f1e6e): created successfully Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (382de9c2-6cff-4b54-bf8a-abd794b662c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Flow 'volume_create_manager' (7ea98dd9-02f5-4040-8749-e359a8f05cc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:34 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-5daa94c7-ae08-48dd-8a9c-90cc877428f6 tempest-ProjectReaderTests-556153323 None] Created volume successfully. Nov 04 19:07:34 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d058797e-ee12-4542-b0ee-4f1f94fd4285 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f0fb3767-8e88-4146-9b9b-ee285443c000" returned: 0 in 0.287s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d058797e-ee12-4542-b0ee-4f1f94fd4285 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-quobyte-f0fb3767-8e88-4146-9b9b-ee285443c000" released by "delete_volume" :: held 0.739s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-d058797e-ee12-4542-b0ee-4f1f94fd4285 tempest-CreateVolumesFromSnapshotTest-340308143 None] Created reservations ['50924a46-d2fe-4aeb-b928-1d4c3bb49d97', '72de137b-9bc6-47d7-b633-67d10b604bee', 'f6f0c031-6ad2-4066-a926-08952ce91e66', '560dccff-863a-4527-b8e7-c85380dbdb69'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d058797e-ee12-4542-b0ee-4f1f94fd4285 tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d058797e-ee12-4542-b0ee-4f1f94fd4285 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d058797e-ee12-4542-b0ee-4f1f94fd4285 tempest-CreateVolumesFromSnapshotTest-340308143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d058797e-ee12-4542-b0ee-4f1f94fd4285 tempest-CreateVolumesFromSnapshotTest-340308143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d058797e-ee12-4542-b0ee-4f1f94fd4285 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d058797e-ee12-4542-b0ee-4f1f94fd4285 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:34 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:07:34 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:34 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1aeac9db-750a-4ede-9748-7050883e5a53 1073741824" returned: 0 in 0.565s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f0932e0a-29af-459c-8faf-954d23f66414 tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "cinder-c5f743e9-5ddb-43f6-9ac9-04510db24739-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f0932e0a-29af-459c-8faf-954d23f66414 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-c5f743e9-5ddb-43f6-9ac9-04510db24739-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1aeac9db-750a-4ede-9748-7050883e5a53 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:35 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1aeac9db-750a-4ede-9748-7050883e5a53 Nov 04 19:07:35 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f0932e0a-29af-459c-8faf-954d23f66414 tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "cinder-quobyte-c5f743e9-5ddb-43f6-9ac9-04510db24739" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:35 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d058797e-ee12-4542-b0ee-4f1f94fd4285 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.347s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-d058797e-ee12-4542-b0ee-4f1f94fd4285 tempest-CreateVolumesFromSnapshotTest-340308143 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f0932e0a-29af-459c-8faf-954d23f66414 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-quobyte-c5f743e9-5ddb-43f6-9ac9-04510db24739" acquired by "delete_volume" :: waited 0.026s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:35 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-d058797e-ee12-4542-b0ee-4f1f94fd4285 tempest-CreateVolumesFromSnapshotTest-340308143 None] Deleted volume successfully. Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[458320c0-7dc9-4634-901b-bc24b39d3130]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f0932e0a-29af-459c-8faf-954d23f66414 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c5f743e9-5ddb-43f6-9ac9-04510db24739 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d058797e-ee12-4542-b0ee-4f1f94fd4285 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-f0fb3767-8e88-4146-9b9b-ee285443c000-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:35 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c5f743e9-5ddb-43f6-9ac9-04510db24739 Nov 04 19:07:35 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:35 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1aeac9db-750a-4ede-9748-7050883e5a53" returned: 0 in 0.310s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deab666a-1262-4950-ad5d-8b11d9d3646a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aeac9db-750a-4ede-9748-7050883e5a53', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c278c01e-9d98-414b-a94b-2f9e08937bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:35 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Volume volume-1aeac9db-750a-4ede-9748-7050883e5a53 (1aeac9db-750a-4ede-9748-7050883e5a53): created successfully Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c278c01e-9d98-414b-a94b-2f9e08937bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Flow 'volume_create_manager' (598f7163-11d2-41c3-a02c-51647b167a9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:35 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-08f48610-7dff-4bfa-9cbd-39732728817b tempest-ProjectReaderTests-2137383739 None] Created volume successfully. Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-dd82d136-6c17-4818-b988-8fde16984c11 tempest-ProjectReaderTests-556153323 None] Acquiring lock "cinder-adc522ed-a7ca-4efa-86d6-6c99997f1e6e-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-dd82d136-6c17-4818-b988-8fde16984c11 tempest-ProjectReaderTests-556153323 None] Lock "cinder-adc522ed-a7ca-4efa-86d6-6c99997f1e6e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-dd82d136-6c17-4818-b988-8fde16984c11 tempest-ProjectReaderTests-556153323 None] Acquiring lock "cinder-quobyte-adc522ed-a7ca-4efa-86d6-6c99997f1e6e" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:35 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f0932e0a-29af-459c-8faf-954d23f66414 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c5f743e9-5ddb-43f6-9ac9-04510db24739" returned: 0 in 0.451s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f0932e0a-29af-459c-8faf-954d23f66414 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c5f743e9-5ddb-43f6-9ac9-04510db24739 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-dd82d136-6c17-4818-b988-8fde16984c11 tempest-ProjectReaderTests-556153323 None] Lock "cinder-quobyte-adc522ed-a7ca-4efa-86d6-6c99997f1e6e" acquired by "delete_volume" :: waited 0.027s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:35 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c5f743e9-5ddb-43f6-9ac9-04510db24739 Nov 04 19:07:35 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4b711f-e75f-45b6-ad98-338c8d11d3f4]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-dd82d136-6c17-4818-b988-8fde16984c11 tempest-ProjectReaderTests-556153323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-adc522ed-a7ca-4efa-86d6-6c99997f1e6e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:35 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-adc522ed-a7ca-4efa-86d6-6c99997f1e6e Nov 04 19:07:35 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:35 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f0932e0a-29af-459c-8faf-954d23f66414 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-c5f743e9-5ddb-43f6-9ac9-04510db24739" returned: 0 in 0.286s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f0932e0a-29af-459c-8faf-954d23f66414 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-quobyte-c5f743e9-5ddb-43f6-9ac9-04510db24739" released by "delete_volume" :: held 0.789s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-f0932e0a-29af-459c-8faf-954d23f66414 tempest-CreateVolumesFromSnapshotTest-340308143 None] Created reservations ['ef31ffec-6b72-4cae-ac01-0ad180ad25ee', '2bc5915d-6a78-4374-80ef-e540eb3ae468', '5aab4d1c-b4d8-417f-a640-de0f07fc2fcc', '61340075-17d3-464c-a8bc-ae58cd6fa166'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f0932e0a-29af-459c-8faf-954d23f66414 tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f0932e0a-29af-459c-8faf-954d23f66414 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f0932e0a-29af-459c-8faf-954d23f66414 tempest-CreateVolumesFromSnapshotTest-340308143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f0932e0a-29af-459c-8faf-954d23f66414 tempest-CreateVolumesFromSnapshotTest-340308143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f0932e0a-29af-459c-8faf-954d23f66414 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f0932e0a-29af-459c-8faf-954d23f66414 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:36 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:07:36 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:36 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-dd82d136-6c17-4818-b988-8fde16984c11 tempest-ProjectReaderTests-556153323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-adc522ed-a7ca-4efa-86d6-6c99997f1e6e" returned: 0 in 0.432s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-dd82d136-6c17-4818-b988-8fde16984c11 tempest-ProjectReaderTests-556153323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-adc522ed-a7ca-4efa-86d6-6c99997f1e6e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:36 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-adc522ed-a7ca-4efa-86d6-6c99997f1e6e Nov 04 19:07:36 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3c5a97b9-914f-40ef-a5ec-ee710955881d tempest-ProjectReaderTests-2137383739 None] Acquiring lock "cinder-1aeac9db-750a-4ede-9748-7050883e5a53-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3c5a97b9-914f-40ef-a5ec-ee710955881d tempest-ProjectReaderTests-2137383739 None] Lock "cinder-1aeac9db-750a-4ede-9748-7050883e5a53-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e85e0aa7-469a-4a43-b915-188ab44f0b1c tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "cinder-3a1b716b-cffc-4e29-a53f-1c0ff0615022-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e85e0aa7-469a-4a43-b915-188ab44f0b1c tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-3a1b716b-cffc-4e29-a53f-1c0ff0615022-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3c5a97b9-914f-40ef-a5ec-ee710955881d tempest-ProjectReaderTests-2137383739 None] Acquiring lock "cinder-quobyte-1aeac9db-750a-4ede-9748-7050883e5a53" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3c5a97b9-914f-40ef-a5ec-ee710955881d tempest-ProjectReaderTests-2137383739 None] Lock "cinder-quobyte-1aeac9db-750a-4ede-9748-7050883e5a53" acquired by "delete_volume" :: waited 0.036s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:36 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f0932e0a-29af-459c-8faf-954d23f66414 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.304s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-f0932e0a-29af-459c-8faf-954d23f66414 tempest-CreateVolumesFromSnapshotTest-340308143 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e85e0aa7-469a-4a43-b915-188ab44f0b1c tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "cinder-quobyte-3a1b716b-cffc-4e29-a53f-1c0ff0615022" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:36 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-f0932e0a-29af-459c-8faf-954d23f66414 tempest-CreateVolumesFromSnapshotTest-340308143 None] Deleted volume successfully. Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5fc4be-0175-4961-95b3-4f15fb66b1dd]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3c5a97b9-914f-40ef-a5ec-ee710955881d tempest-ProjectReaderTests-2137383739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1aeac9db-750a-4ede-9748-7050883e5a53 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e85e0aa7-469a-4a43-b915-188ab44f0b1c tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-quobyte-3a1b716b-cffc-4e29-a53f-1c0ff0615022" acquired by "delete_volume" :: waited 0.043s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f0932e0a-29af-459c-8faf-954d23f66414 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-c5f743e9-5ddb-43f6-9ac9-04510db24739-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c95994-89ba-427a-9c65-3b441ada7341]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e85e0aa7-469a-4a43-b915-188ab44f0b1c tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a1b716b-cffc-4e29-a53f-1c0ff0615022 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:36 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-dd82d136-6c17-4818-b988-8fde16984c11 tempest-ProjectReaderTests-556153323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-adc522ed-a7ca-4efa-86d6-6c99997f1e6e" returned: 0 in 0.412s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-dd82d136-6c17-4818-b988-8fde16984c11 tempest-ProjectReaderTests-556153323 None] Lock "cinder-quobyte-adc522ed-a7ca-4efa-86d6-6c99997f1e6e" released by "delete_volume" :: held 0.904s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:36 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1aeac9db-750a-4ede-9748-7050883e5a53 Nov 04 19:07:36 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:36 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a1b716b-cffc-4e29-a53f-1c0ff0615022 Nov 04 19:07:36 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-dd82d136-6c17-4818-b988-8fde16984c11 tempest-ProjectReaderTests-556153323 None] Created reservations ['49ec076b-324b-4a24-b686-01b9b59717b0', 'bb82fb40-dbc4-46cb-ab9c-7c9d2d70f33e', '9fd48ce4-74f3-4a05-ab5d-19071a0e4fd7', '64e7c48b-7fc5-4ca7-af8d-e0c513fa21dd'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-dd82d136-6c17-4818-b988-8fde16984c11 tempest-ProjectReaderTests-556153323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-dd82d136-6c17-4818-b988-8fde16984c11 tempest-ProjectReaderTests-556153323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-dd82d136-6c17-4818-b988-8fde16984c11 tempest-ProjectReaderTests-556153323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-dd82d136-6c17-4818-b988-8fde16984c11 tempest-ProjectReaderTests-556153323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-dd82d136-6c17-4818-b988-8fde16984c11 tempest-ProjectReaderTests-556153323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-dd82d136-6c17-4818-b988-8fde16984c11 tempest-ProjectReaderTests-556153323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:36 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:07:36 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:36 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3c5a97b9-914f-40ef-a5ec-ee710955881d tempest-ProjectReaderTests-2137383739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1aeac9db-750a-4ede-9748-7050883e5a53" returned: 0 in 0.501s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3c5a97b9-914f-40ef-a5ec-ee710955881d tempest-ProjectReaderTests-2137383739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1aeac9db-750a-4ede-9748-7050883e5a53 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:36 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e85e0aa7-469a-4a43-b915-188ab44f0b1c tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a1b716b-cffc-4e29-a53f-1c0ff0615022" returned: 0 in 0.464s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e85e0aa7-469a-4a43-b915-188ab44f0b1c tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a1b716b-cffc-4e29-a53f-1c0ff0615022 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:36 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1aeac9db-750a-4ede-9748-7050883e5a53 Nov 04 19:07:36 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:36 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a1b716b-cffc-4e29-a53f-1c0ff0615022 Nov 04 19:07:36 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:36 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-dd82d136-6c17-4818-b988-8fde16984c11 tempest-ProjectReaderTests-556153323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.319s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-dd82d136-6c17-4818-b988-8fde16984c11 tempest-ProjectReaderTests-556153323 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:36 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-dd82d136-6c17-4818-b988-8fde16984c11 tempest-ProjectReaderTests-556153323 None] Deleted volume successfully. Nov 04 19:07:36 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-dd82d136-6c17-4818-b988-8fde16984c11 tempest-ProjectReaderTests-556153323 None] Lock "cinder-adc522ed-a7ca-4efa-86d6-6c99997f1e6e-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:37 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e85e0aa7-469a-4a43-b915-188ab44f0b1c tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-3a1b716b-cffc-4e29-a53f-1c0ff0615022" returned: 0 in 0.375s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e85e0aa7-469a-4a43-b915-188ab44f0b1c tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-quobyte-3a1b716b-cffc-4e29-a53f-1c0ff0615022" released by "delete_volume" :: held 0.905s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:37 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3c5a97b9-914f-40ef-a5ec-ee710955881d tempest-ProjectReaderTests-2137383739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1aeac9db-750a-4ede-9748-7050883e5a53" returned: 0 in 0.435s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3c5a97b9-914f-40ef-a5ec-ee710955881d tempest-ProjectReaderTests-2137383739 None] Lock "cinder-quobyte-1aeac9db-750a-4ede-9748-7050883e5a53" released by "delete_volume" :: held 1.021s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Flow 'volume_create_manager' (732c79fa-4d73-4bef-a3c0-8872616d91d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324c7f5f-1b02-4161-8965-0b58964330b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324c7f5f-1b02-4161-8965-0b58964330b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1075136581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b39fac69-d15b-4995-bed1-f568519a32eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d3eb206cad94084a5c6283e2ff66444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:37Z,use_quota=True,user_id='ddf65909617d4434b557a176d0457659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1821fe68-5d36-4786-aac3-0f45b58ea994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1821fe68-5d36-4786-aac3-0f45b58ea994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bbce530-f0b2-479e-8dcd-94aa2a056651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bbce530-f0b2-479e-8dcd-94aa2a056651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b39fac69-d15b-4995-bed1-f568519a32eb', 'volume_name': 'volume-b39fac69-d15b-4995-bed1-f568519a32eb', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d779754e-43a5-4f9c-bd70-e905c1040f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d779754e-43a5-4f9c-bd70-e905c1040f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f93c6b9e-2bc0-4501-b378-282a3efbf0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:37 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Volume b39fac69-d15b-4995-bed1-f568519a32eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b39fac69-d15b-4995-bed1-f568519a32eb', 'volume_size': 1} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1075136581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b39fac69-d15b-4995-bed1-f568519a32eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d3eb206cad94084a5c6283e2ff66444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:37Z,use_quota=True,user_id='ddf65909617d4434b557a176d0457659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Creating volume b39fac69-d15b-4995-bed1-f568519a32eb {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:37 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b39fac69-d15b-4995-bed1-f568519a32eb 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:37 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b39fac69-d15b-4995-bed1-f568519a32eb 1073741824 Nov 04 19:07:37 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-3c5a97b9-914f-40ef-a5ec-ee710955881d tempest-ProjectReaderTests-2137383739 None] Created reservations ['dc7e96e5-7174-4748-842f-8d82f11dabea', 'e4e359b7-2525-48b8-8ea4-fa830f71c30d', '74a56ab5-fea9-4b4f-afa4-42d1d578186d', 'c0c8b5bc-bd96-426d-95d6-4b4713ec65ea'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-e85e0aa7-469a-4a43-b915-188ab44f0b1c tempest-CreateVolumesFromSnapshotTest-340308143 None] Created reservations ['ba002729-0404-484f-b486-bea7a6cbc925', 'bb38fc78-2647-4d09-8a87-3b75a09d1eed', 'de15ddc5-6e58-4de3-b650-381d512d8bbc', 'f2f2e31d-e3f7-4081-8d43-105403a46458'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3c5a97b9-914f-40ef-a5ec-ee710955881d tempest-ProjectReaderTests-2137383739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3c5a97b9-914f-40ef-a5ec-ee710955881d tempest-ProjectReaderTests-2137383739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3c5a97b9-914f-40ef-a5ec-ee710955881d tempest-ProjectReaderTests-2137383739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-3c5a97b9-914f-40ef-a5ec-ee710955881d tempest-ProjectReaderTests-2137383739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-3c5a97b9-914f-40ef-a5ec-ee710955881d tempest-ProjectReaderTests-2137383739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3c5a97b9-914f-40ef-a5ec-ee710955881d tempest-ProjectReaderTests-2137383739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e85e0aa7-469a-4a43-b915-188ab44f0b1c tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e85e0aa7-469a-4a43-b915-188ab44f0b1c tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e85e0aa7-469a-4a43-b915-188ab44f0b1c tempest-CreateVolumesFromSnapshotTest-340308143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e85e0aa7-469a-4a43-b915-188ab44f0b1c tempest-CreateVolumesFromSnapshotTest-340308143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e85e0aa7-469a-4a43-b915-188ab44f0b1c tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e85e0aa7-469a-4a43-b915-188ab44f0b1c tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:37 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:07:37 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:37 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:07:37 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:37 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-3c5a97b9-914f-40ef-a5ec-ee710955881d tempest-ProjectReaderTests-2137383739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.328s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-3c5a97b9-914f-40ef-a5ec-ee710955881d tempest-ProjectReaderTests-2137383739 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:37 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:37 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-3c5a97b9-914f-40ef-a5ec-ee710955881d tempest-ProjectReaderTests-2137383739 None] Deleted volume successfully. Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e85e0aa7-469a-4a43-b915-188ab44f0b1c tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.312s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-e85e0aa7-469a-4a43-b915-188ab44f0b1c tempest-CreateVolumesFromSnapshotTest-340308143 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:37 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e85e0aa7-469a-4a43-b915-188ab44f0b1c tempest-CreateVolumesFromSnapshotTest-340308143 None] Deleted volume successfully. Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-3c5a97b9-914f-40ef-a5ec-ee710955881d tempest-ProjectReaderTests-2137383739 None] Lock "cinder-1aeac9db-750a-4ede-9748-7050883e5a53-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e85e0aa7-469a-4a43-b915-188ab44f0b1c tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-3a1b716b-cffc-4e29-a53f-1c0ff0615022-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:37 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b39fac69-d15b-4995-bed1-f568519a32eb 1073741824" returned: 0 in 0.574s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b39fac69-d15b-4995-bed1-f568519a32eb {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:38 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b39fac69-d15b-4995-bed1-f568519a32eb Nov 04 19:07:38 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:38 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b39fac69-d15b-4995-bed1-f568519a32eb" returned: 0 in 0.235s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f93c6b9e-2bc0-4501-b378-282a3efbf0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b39fac69-d15b-4995-bed1-f568519a32eb', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1269ab8-371c-47c6-8762-56862011a63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:38 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Volume volume-b39fac69-d15b-4995-bed1-f568519a32eb (b39fac69-d15b-4995-bed1-f568519a32eb): created successfully Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1269ab8-371c-47c6-8762-56862011a63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Flow 'volume_create_manager' (732c79fa-4d73-4bef-a3c0-8872616d91d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:38 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-288fd5d6-6cb5-404a-af32-e125d3dd6758 tempest-ProjectReaderTests-556153323 None] Created volume successfully. Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b74045c4-71d1-4d77-9b74-e7233085f899 tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "cinder-447a6481-d0d4-4ada-bf0b-ac0e866b3fcc-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b74045c4-71d1-4d77-9b74-e7233085f899 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-447a6481-d0d4-4ada-bf0b-ac0e866b3fcc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b74045c4-71d1-4d77-9b74-e7233085f899 tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "cinder-quobyte-447a6481-d0d4-4ada-bf0b-ac0e866b3fcc" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b74045c4-71d1-4d77-9b74-e7233085f899 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-quobyte-447a6481-d0d4-4ada-bf0b-ac0e866b3fcc" acquired by "delete_volume" :: waited 0.017s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a71df01-d166-41c4-94fa-322d734db87f]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b74045c4-71d1-4d77-9b74-e7233085f899 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-447a6481-d0d4-4ada-bf0b-ac0e866b3fcc {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:38 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-447a6481-d0d4-4ada-bf0b-ac0e866b3fcc Nov 04 19:07:38 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Flow 'volume_create_manager' (62b83bd8-b0eb-488a-bd65-df8eaa019bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e14c63a-4fba-4181-8314-cfd5f7a0c0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e14c63a-4fba-4181-8314-cfd5f7a0c0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-729292230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f7c546-e5d3-4758-ac1d-55b38ceb1bf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a92b36959644800805f7a80103c44a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:39Z,use_quota=True,user_id='f76b1503007c432faf044eb9fa69079d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f6d23c-9fd2-40e1-a439-72cad16efa6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f6d23c-9fd2-40e1-a439-72cad16efa6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bdeb884-737f-4003-a56d-2978613aab24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:38 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bdeb884-737f-4003-a56d-2978613aab24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86f7c546-e5d3-4758-ac1d-55b38ceb1bf7', 'volume_name': 'volume-86f7c546-e5d3-4758-ac1d-55b38ceb1bf7', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0f65350-33f4-444f-a2ef-b7c3b29d4961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0f65350-33f4-444f-a2ef-b7c3b29d4961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005155aa-b031-4cfb-8e79-cc90282ae245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:38 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Volume 86f7c546-e5d3-4758-ac1d-55b38ceb1bf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86f7c546-e5d3-4758-ac1d-55b38ceb1bf7', 'volume_size': 1} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-729292230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f7c546-e5d3-4758-ac1d-55b38ceb1bf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a92b36959644800805f7a80103c44a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:39Z,use_quota=True,user_id='f76b1503007c432faf044eb9fa69079d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Creating volume 86f7c546-e5d3-4758-ac1d-55b38ceb1bf7 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:38 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-86f7c546-e5d3-4758-ac1d-55b38ceb1bf7 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b74045c4-71d1-4d77-9b74-e7233085f899 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-447a6481-d0d4-4ada-bf0b-ac0e866b3fcc" returned: 0 in 0.442s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b74045c4-71d1-4d77-9b74-e7233085f899 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-447a6481-d0d4-4ada-bf0b-ac0e866b3fcc {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:38 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-86f7c546-e5d3-4758-ac1d-55b38ceb1bf7 1073741824 Nov 04 19:07:38 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:38 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-447a6481-d0d4-4ada-bf0b-ac0e866b3fcc Nov 04 19:07:38 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:39 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b74045c4-71d1-4d77-9b74-e7233085f899 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-447a6481-d0d4-4ada-bf0b-ac0e866b3fcc" returned: 0 in 0.277s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:39 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b74045c4-71d1-4d77-9b74-e7233085f899 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-quobyte-447a6481-d0d4-4ada-bf0b-ac0e866b3fcc" released by "delete_volume" :: held 0.766s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:39 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-b74045c4-71d1-4d77-9b74-e7233085f899 tempest-CreateVolumesFromSnapshotTest-340308143 None] Created reservations ['62cabdf8-7aa6-4c05-ba19-a180ba67fbe7', 'b4b7eb40-d879-44ac-b5aa-b1e2df02e734', 'c9c97451-7a15-46fd-bc0f-6328f8c89ff7', '2c0f6408-b56a-4dc8-81f2-8802137d3b5c'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:39 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-55695fcb-71b7-4948-933b-6e23c552e7db tempest-ProjectReaderTests-556153323 None] Acquiring lock "cinder-b39fac69-d15b-4995-bed1-f568519a32eb-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:39 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-55695fcb-71b7-4948-933b-6e23c552e7db tempest-ProjectReaderTests-556153323 None] Lock "cinder-b39fac69-d15b-4995-bed1-f568519a32eb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b74045c4-71d1-4d77-9b74-e7233085f899 tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b74045c4-71d1-4d77-9b74-e7233085f899 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:39 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-b74045c4-71d1-4d77-9b74-e7233085f899 tempest-CreateVolumesFromSnapshotTest-340308143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:39 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-b74045c4-71d1-4d77-9b74-e7233085f899 tempest-CreateVolumesFromSnapshotTest-340308143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b74045c4-71d1-4d77-9b74-e7233085f899 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b74045c4-71d1-4d77-9b74-e7233085f899 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:39 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:07:39 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:39 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-55695fcb-71b7-4948-933b-6e23c552e7db tempest-ProjectReaderTests-556153323 None] Acquiring lock "cinder-quobyte-b39fac69-d15b-4995-bed1-f568519a32eb" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:39 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-86f7c546-e5d3-4758-ac1d-55b38ceb1bf7 1073741824" returned: 0 in 0.592s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:39 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-55695fcb-71b7-4948-933b-6e23c552e7db tempest-ProjectReaderTests-556153323 None] Lock "cinder-quobyte-b39fac69-d15b-4995-bed1-f568519a32eb" acquired by "delete_volume" :: waited 0.035s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:39 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da759ae-0313-4e83-879a-b67ab4b3fec2]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-55695fcb-71b7-4948-933b-6e23c552e7db tempest-ProjectReaderTests-556153323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b39fac69-d15b-4995-bed1-f568519a32eb {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:39 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-649c1199-7cb4-4e61-ab57-54ed72187ef4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "cinder-6133c48f-e6f1-40c9-9d23-8997604ca73b-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-86f7c546-e5d3-4758-ac1d-55b38ceb1bf7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:39 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-649c1199-7cb4-4e61-ab57-54ed72187ef4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-6133c48f-e6f1-40c9-9d23-8997604ca73b-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:39 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-86f7c546-e5d3-4758-ac1d-55b38ceb1bf7 Nov 04 19:07:39 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:39 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b39fac69-d15b-4995-bed1-f568519a32eb Nov 04 19:07:39 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:39 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-649c1199-7cb4-4e61-ab57-54ed72187ef4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "cinder-quobyte-6133c48f-e6f1-40c9-9d23-8997604ca73b" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:39 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-649c1199-7cb4-4e61-ab57-54ed72187ef4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-quobyte-6133c48f-e6f1-40c9-9d23-8997604ca73b" acquired by "delete_volume" :: waited 0.036s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:39 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b74045c4-71d1-4d77-9b74-e7233085f899 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.395s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:39 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-b74045c4-71d1-4d77-9b74-e7233085f899 tempest-CreateVolumesFromSnapshotTest-340308143 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:39 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-b74045c4-71d1-4d77-9b74-e7233085f899 tempest-CreateVolumesFromSnapshotTest-340308143 None] Deleted volume successfully. Nov 04 19:07:39 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb001c4-3861-4408-90f3-c616c1572977]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-649c1199-7cb4-4e61-ab57-54ed72187ef4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6133c48f-e6f1-40c9-9d23-8997604ca73b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:39 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-b74045c4-71d1-4d77-9b74-e7233085f899 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-447a6481-d0d4-4ada-bf0b-ac0e866b3fcc-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:40 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6133c48f-e6f1-40c9-9d23-8997604ca73b Nov 04 19:07:40 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:40 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-86f7c546-e5d3-4758-ac1d-55b38ceb1bf7" returned: 0 in 0.372s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005155aa-b031-4cfb-8e79-cc90282ae245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86f7c546-e5d3-4758-ac1d-55b38ceb1bf7', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd250b93-1b32-4e9d-8065-a8488e5888c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:40 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:40 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Volume volume-86f7c546-e5d3-4758-ac1d-55b38ceb1bf7 (86f7c546-e5d3-4758-ac1d-55b38ceb1bf7): created successfully Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd250b93-1b32-4e9d-8065-a8488e5888c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Flow 'volume_create_manager' (62b83bd8-b0eb-488a-bd65-df8eaa019bb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-55695fcb-71b7-4948-933b-6e23c552e7db tempest-ProjectReaderTests-556153323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b39fac69-d15b-4995-bed1-f568519a32eb" returned: 0 in 0.495s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-55695fcb-71b7-4948-933b-6e23c552e7db tempest-ProjectReaderTests-556153323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b39fac69-d15b-4995-bed1-f568519a32eb {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:40 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-337a50a0-8309-41d7-a6ea-8200d85e5944 tempest-ProjectReaderTests-2137383739 None] Created volume successfully. Nov 04 19:07:40 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b39fac69-d15b-4995-bed1-f568519a32eb Nov 04 19:07:40 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:40 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-649c1199-7cb4-4e61-ab57-54ed72187ef4 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6133c48f-e6f1-40c9-9d23-8997604ca73b" returned: 0 in 0.420s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-649c1199-7cb4-4e61-ab57-54ed72187ef4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6133c48f-e6f1-40c9-9d23-8997604ca73b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:40 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6133c48f-e6f1-40c9-9d23-8997604ca73b Nov 04 19:07:40 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:40 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-55695fcb-71b7-4948-933b-6e23c552e7db tempest-ProjectReaderTests-556153323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b39fac69-d15b-4995-bed1-f568519a32eb" returned: 0 in 0.277s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-55695fcb-71b7-4948-933b-6e23c552e7db tempest-ProjectReaderTests-556153323 None] Lock "cinder-quobyte-b39fac69-d15b-4995-bed1-f568519a32eb" released by "delete_volume" :: held 0.835s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-55695fcb-71b7-4948-933b-6e23c552e7db tempest-ProjectReaderTests-556153323 None] Created reservations ['95a2d575-31e0-4d1b-941d-4e36071bf24c', 'e995b0e3-89a6-4e07-b09d-d8e567061f9d', '94b6c7d4-7dcd-4acd-8be9-5088494770cb', 'addef61c-a682-4f4d-8ae0-b9ab45d45b5c'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-55695fcb-71b7-4948-933b-6e23c552e7db tempest-ProjectReaderTests-556153323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-55695fcb-71b7-4948-933b-6e23c552e7db tempest-ProjectReaderTests-556153323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-55695fcb-71b7-4948-933b-6e23c552e7db tempest-ProjectReaderTests-556153323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-55695fcb-71b7-4948-933b-6e23c552e7db tempest-ProjectReaderTests-556153323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-55695fcb-71b7-4948-933b-6e23c552e7db tempest-ProjectReaderTests-556153323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-55695fcb-71b7-4948-933b-6e23c552e7db tempest-ProjectReaderTests-556153323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:40 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:07:40 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:40 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-649c1199-7cb4-4e61-ab57-54ed72187ef4 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-6133c48f-e6f1-40c9-9d23-8997604ca73b" returned: 0 in 0.270s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-649c1199-7cb4-4e61-ab57-54ed72187ef4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-quobyte-6133c48f-e6f1-40c9-9d23-8997604ca73b" released by "delete_volume" :: held 0.758s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-649c1199-7cb4-4e61-ab57-54ed72187ef4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Created reservations ['ddef41de-ae65-4beb-8926-dae08a41663c', '8d863773-e41d-40e9-a92f-2dd10f5ea16c', 'e52de860-5fb2-473d-a4fb-8807d1cd3aee', 'f07fa047-16aa-45aa-96cc-bffc353da634'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-649c1199-7cb4-4e61-ab57-54ed72187ef4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-649c1199-7cb4-4e61-ab57-54ed72187ef4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-649c1199-7cb4-4e61-ab57-54ed72187ef4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-649c1199-7cb4-4e61-ab57-54ed72187ef4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-649c1199-7cb4-4e61-ab57-54ed72187ef4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-649c1199-7cb4-4e61-ab57-54ed72187ef4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:40 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:07:40 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-8883710b-b32e-4d10-a087-79b456e9d869 tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "cinder-6b3da420-cd2c-47d5-9bdd-a22024340a2d-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:40 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-55695fcb-71b7-4948-933b-6e23c552e7db tempest-ProjectReaderTests-556153323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.315s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-55695fcb-71b7-4948-933b-6e23c552e7db tempest-ProjectReaderTests-556153323 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-8883710b-b32e-4d10-a087-79b456e9d869 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-6b3da420-cd2c-47d5-9bdd-a22024340a2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-8883710b-b32e-4d10-a087-79b456e9d869 tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "cinder-quobyte-7809a5f8-487e-4869-8b08-ac6e2d72b870" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:40 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-55695fcb-71b7-4948-933b-6e23c552e7db tempest-ProjectReaderTests-556153323 None] Deleted volume successfully. Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-8883710b-b32e-4d10-a087-79b456e9d869 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-quobyte-7809a5f8-487e-4869-8b08-ac6e2d72b870" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-8883710b-b32e-4d10-a087-79b456e9d869 tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "cinder-quobyte-6b3da420-cd2c-47d5-9bdd-a22024340a2d" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-55695fcb-71b7-4948-933b-6e23c552e7db tempest-ProjectReaderTests-556153323 None] Lock "cinder-b39fac69-d15b-4995-bed1-f568519a32eb-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-8883710b-b32e-4d10-a087-79b456e9d869 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-quobyte-6b3da420-cd2c-47d5-9bdd-a22024340a2d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-8883710b-b32e-4d10-a087-79b456e9d869 tempest-CreateVolumesFromSnapshotTest-340308143 None] Deleting offline snapshot 6b3da420-cd2c-47d5-9bdd-a22024340a2d of volume 7809a5f8-487e-4869-8b08-ac6e2d72b870 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-8883710b-b32e-4d10-a087-79b456e9d869 tempest-CreateVolumesFromSnapshotTest-340308143 None] snapshot_file for this snap is: volume-7809a5f8-487e-4869-8b08-ac6e2d72b870.6b3da420-cd2c-47d5-9bdd-a22024340a2d {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[000f7964-73e0-4ab1-aabe-c229ddc64c98]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:40 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8883710b-b32e-4d10-a087-79b456e9d869 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870.6b3da420-cd2c-47d5-9bdd-a22024340a2d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:41 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-649c1199-7cb4-4e61-ab57-54ed72187ef4 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.377s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:41 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-649c1199-7cb4-4e61-ab57-54ed72187ef4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:41 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-649c1199-7cb4-4e61-ab57-54ed72187ef4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Deleted volume successfully. Nov 04 19:07:41 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1af6bf85-fe87-4314-8c75-61c85aa28c2b tempest-ProjectReaderTests-2137383739 None] Acquiring lock "cinder-86f7c546-e5d3-4758-ac1d-55b38ceb1bf7-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:41 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-649c1199-7cb4-4e61-ab57-54ed72187ef4 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-6133c48f-e6f1-40c9-9d23-8997604ca73b-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:41 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870.6b3da420-cd2c-47d5-9bdd-a22024340a2d Nov 04 19:07:41 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:41 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1af6bf85-fe87-4314-8c75-61c85aa28c2b tempest-ProjectReaderTests-2137383739 None] Lock "cinder-86f7c546-e5d3-4758-ac1d-55b38ceb1bf7-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:41 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1af6bf85-fe87-4314-8c75-61c85aa28c2b tempest-ProjectReaderTests-2137383739 None] Acquiring lock "cinder-quobyte-86f7c546-e5d3-4758-ac1d-55b38ceb1bf7" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:41 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1af6bf85-fe87-4314-8c75-61c85aa28c2b tempest-ProjectReaderTests-2137383739 None] Lock "cinder-quobyte-86f7c546-e5d3-4758-ac1d-55b38ceb1bf7" acquired by "delete_volume" :: waited 0.017s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:41 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[7709d892-9013-4fed-8235-2d09f6ba837b]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1af6bf85-fe87-4314-8c75-61c85aa28c2b tempest-ProjectReaderTests-2137383739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-86f7c546-e5d3-4758-ac1d-55b38ceb1bf7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:41 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-86f7c546-e5d3-4758-ac1d-55b38ceb1bf7 Nov 04 19:07:41 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:41 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8883710b-b32e-4d10-a087-79b456e9d869 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870.6b3da420-cd2c-47d5-9bdd-a22024340a2d" returned: 0 in 0.561s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:41 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-8883710b-b32e-4d10-a087-79b456e9d869 tempest-CreateVolumesFromSnapshotTest-340308143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7809a5f8-487e-4869-8b08-ac6e2d72b870(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:07:41 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ad2a91-a090-40de-9a9b-fb55c20900a6]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8883710b-b32e-4d10-a087-79b456e9d869 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:41 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870 Nov 04 19:07:41 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:41 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1af6bf85-fe87-4314-8c75-61c85aa28c2b tempest-ProjectReaderTests-2137383739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-86f7c546-e5d3-4758-ac1d-55b38ceb1bf7" returned: 0 in 0.511s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:41 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1af6bf85-fe87-4314-8c75-61c85aa28c2b tempest-ProjectReaderTests-2137383739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-86f7c546-e5d3-4758-ac1d-55b38ceb1bf7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:41 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-86f7c546-e5d3-4758-ac1d-55b38ceb1bf7 Nov 04 19:07:41 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:42 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8883710b-b32e-4d10-a087-79b456e9d869 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870" returned: 0 in 0.516s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8883710b-b32e-4d10-a087-79b456e9d869 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870.6b3da420-cd2c-47d5-9bdd-a22024340a2d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:42 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870.6b3da420-cd2c-47d5-9bdd-a22024340a2d Nov 04 19:07:42 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:42 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1af6bf85-fe87-4314-8c75-61c85aa28c2b tempest-ProjectReaderTests-2137383739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-86f7c546-e5d3-4758-ac1d-55b38ceb1bf7" returned: 0 in 0.383s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1af6bf85-fe87-4314-8c75-61c85aa28c2b tempest-ProjectReaderTests-2137383739 None] Lock "cinder-quobyte-86f7c546-e5d3-4758-ac1d-55b38ceb1bf7" released by "delete_volume" :: held 0.956s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:42 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-1af6bf85-fe87-4314-8c75-61c85aa28c2b tempest-ProjectReaderTests-2137383739 None] Created reservations ['34690ea3-7f23-4731-bae9-068cf2ab8f41', '4d849152-36be-4259-a700-069eb20dea59', 'f3c0ea1a-651c-4e2d-8376-a86d56e33b01', 'eca0b86b-6b80-4b88-9be4-556314805642'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1af6bf85-fe87-4314-8c75-61c85aa28c2b tempest-ProjectReaderTests-2137383739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1af6bf85-fe87-4314-8c75-61c85aa28c2b tempest-ProjectReaderTests-2137383739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:42 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1af6bf85-fe87-4314-8c75-61c85aa28c2b tempest-ProjectReaderTests-2137383739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:42 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1af6bf85-fe87-4314-8c75-61c85aa28c2b tempest-ProjectReaderTests-2137383739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1af6bf85-fe87-4314-8c75-61c85aa28c2b tempest-ProjectReaderTests-2137383739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1af6bf85-fe87-4314-8c75-61c85aa28c2b tempest-ProjectReaderTests-2137383739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:42 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:07:42 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:42 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8883710b-b32e-4d10-a087-79b456e9d869 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870.6b3da420-cd2c-47d5-9bdd-a22024340a2d" returned: 0 in 0.482s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8883710b-b32e-4d10-a087-79b456e9d869 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870.6b3da420-cd2c-47d5-9bdd-a22024340a2d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:42 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870.6b3da420-cd2c-47d5-9bdd-a22024340a2d Nov 04 19:07:42 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:42 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1af6bf85-fe87-4314-8c75-61c85aa28c2b tempest-ProjectReaderTests-2137383739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.321s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:42 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-1af6bf85-fe87-4314-8c75-61c85aa28c2b tempest-ProjectReaderTests-2137383739 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:42 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-1af6bf85-fe87-4314-8c75-61c85aa28c2b tempest-ProjectReaderTests-2137383739 None] Deleted volume successfully. Nov 04 19:07:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1af6bf85-fe87-4314-8c75-61c85aa28c2b tempest-ProjectReaderTests-2137383739 None] Lock "cinder-86f7c546-e5d3-4758-ac1d-55b38ceb1bf7-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:42 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:42 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8883710b-b32e-4d10-a087-79b456e9d869 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870.6b3da420-cd2c-47d5-9bdd-a22024340a2d" returned: 0 in 0.296s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-8883710b-b32e-4d10-a087-79b456e9d869 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-quobyte-6b3da420-cd2c-47d5-9bdd-a22024340a2d" released by "_delete_snapshot" :: held 2.040s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:42 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-8883710b-b32e-4d10-a087-79b456e9d869 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-quobyte-7809a5f8-487e-4869-8b08-ac6e2d72b870" released by "delete_snapshot" :: held 2.074s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:43 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-8883710b-b32e-4d10-a087-79b456e9d869 tempest-CreateVolumesFromSnapshotTest-340308143 None] Created reservations ['2fce97e1-dbcb-4e0a-b1ca-5a0f2798acb4', '8d116841-133c-48af-a290-eec706b6aa7e', 'e6d61e29-2987-450b-a0d8-38fd382439f9', '5df82bae-bd1b-48f9-bcfc-49443d5b7a81'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:43 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-8883710b-b32e-4d10-a087-79b456e9d869 tempest-CreateVolumesFromSnapshotTest-340308143 None] Delete snapshot completed successfully. Nov 04 19:07:43 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-8883710b-b32e-4d10-a087-79b456e9d869 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-6b3da420-cd2c-47d5-9bdd-a22024340a2d-delete_snapshot" released by "delete_snapshot" :: held 2.280s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1cd0e774-64cc-4a07-9c9e-c896f285bdb2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "cinder-7809a5f8-487e-4869-8b08-ac6e2d72b870-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1cd0e774-64cc-4a07-9c9e-c896f285bdb2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-7809a5f8-487e-4869-8b08-ac6e2d72b870-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1cd0e774-64cc-4a07-9c9e-c896f285bdb2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "cinder-quobyte-7809a5f8-487e-4869-8b08-ac6e2d72b870" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1cd0e774-64cc-4a07-9c9e-c896f285bdb2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-quobyte-7809a5f8-487e-4869-8b08-ac6e2d72b870" acquired by "delete_volume" :: waited 0.018s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:44 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e0c533-24ca-4996-b30b-183e0f0d0fa8]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1cd0e774-64cc-4a07-9c9e-c896f285bdb2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:44 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870 Nov 04 19:07:44 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:44 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1cd0e774-64cc-4a07-9c9e-c896f285bdb2 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870" returned: 0 in 0.385s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1cd0e774-64cc-4a07-9c9e-c896f285bdb2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:44 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870 Nov 04 19:07:44 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:44 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:44 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1cd0e774-64cc-4a07-9c9e-c896f285bdb2 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7809a5f8-487e-4869-8b08-ac6e2d72b870" returned: 0 in 0.344s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:44 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1cd0e774-64cc-4a07-9c9e-c896f285bdb2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-quobyte-7809a5f8-487e-4869-8b08-ac6e2d72b870" released by "delete_volume" :: held 0.828s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:45 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-1cd0e774-64cc-4a07-9c9e-c896f285bdb2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Created reservations ['15eced9b-edc5-4d0e-80aa-02f17342da37', '3dbfb57a-3b62-4232-a9de-1bd3093e3551', '53a232c9-c4bc-4f52-87dc-971da1fcd72d', '702408f5-836a-4466-9a26-e62476762259'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1cd0e774-64cc-4a07-9c9e-c896f285bdb2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1cd0e774-64cc-4a07-9c9e-c896f285bdb2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1cd0e774-64cc-4a07-9c9e-c896f285bdb2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-1cd0e774-64cc-4a07-9c9e-c896f285bdb2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1cd0e774-64cc-4a07-9c9e-c896f285bdb2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1cd0e774-64cc-4a07-9c9e-c896f285bdb2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:45 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:07:45 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:45 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1cd0e774-64cc-4a07-9c9e-c896f285bdb2 tempest-CreateVolumesFromSnapshotTest-340308143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.373s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:45 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-1cd0e774-64cc-4a07-9c9e-c896f285bdb2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:45 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-1cd0e774-64cc-4a07-9c9e-c896f285bdb2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Deleted volume successfully. Nov 04 19:07:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1cd0e774-64cc-4a07-9c9e-c896f285bdb2 tempest-CreateVolumesFromSnapshotTest-340308143 None] Lock "cinder-7809a5f8-487e-4869-8b08-ac6e2d72b870-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:48 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-dfc655d1-8892-4b16-986b-da4b6bfccf05 tempest-ProjectAdminTests-193901783 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5831718444824, 'free_capacity_gb': 1773.5831718444824, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87119) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 04 19:07:55 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:UPDATE=157,cinder:INSERT=36,cinder:SELECT=101,cinder:DELETE=16 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:07:55 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:DELETE=11,cinder:SELECT=103,cinder:UPDATE=144,cinder:INSERT=37 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:08:02 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:08:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Flow 'volume_create_manager' (dcd289c3-50e9-4dd8-9cba-3a2ad2aa595b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d589f9-f798-4245-8aaf-0436e3e3bf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d589f9-f798-4245-8aaf-0436e3e3bf6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1093902286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1386bbb-116a-4369-b325-0aa0fbdf60f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eea4506f7224002863cfaf3510e93b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:02Z,use_quota=True,user_id='cd1b5ab70cb74972a3562eb0a2e88be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab308175-d878-4e1a-b2e2-e19af3be791b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab308175-d878-4e1a-b2e2-e19af3be791b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c690708c-9b26-48b8-aa38-fc22e1438656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c690708c-9b26-48b8-aa38-fc22e1438656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1386bbb-116a-4369-b325-0aa0fbdf60f5', 'volume_name': 'volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cff6858-45fe-463a-a059-58294833a595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cff6858-45fe-463a-a059-58294833a595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37cb012-cec2-402d-86b0-ab7ea3b89c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:02 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Volume b1386bbb-116a-4369-b325-0aa0fbdf60f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5', 'volume_size': 1} Nov 04 19:08:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1093902286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1386bbb-116a-4369-b325-0aa0fbdf60f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eea4506f7224002863cfaf3510e93b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:02Z,use_quota=True,user_id='cd1b5ab70cb74972a3562eb0a2e88be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:08:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Creating volume b1386bbb-116a-4369-b325-0aa0fbdf60f5 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:08:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:08:02 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:08:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:02 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5 1073741824 Nov 04 19:08:02 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:02 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5 1073741824" returned: 0 in 0.427s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:02 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5 Nov 04 19:08:02 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:03 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5" returned: 0 in 0.263s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:08:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37cb012-cec2-402d-86b0-ab7ea3b89c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ad0fe82-f3c3-4510-a5c6-e620bfef6d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:03 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Volume volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5 (b1386bbb-116a-4369-b325-0aa0fbdf60f5): created successfully Nov 04 19:08:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ad0fe82-f3c3-4510-a5c6-e620bfef6d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:03 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Flow 'volume_create_manager' (dcd289c3-50e9-4dd8-9cba-3a2ad2aa595b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:03 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-521f4bc2-a135-4749-b49d-20697023c1d7 tempest-ProjectMemberTests-1705931170 None] Created volume successfully. Nov 04 19:08:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-54483e79-3927-45fc-b956-fed0df0aec3e tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-54483e79-3927-45fc-b956-fed0df0aec3e tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-54483e79-3927-45fc-b956-fed0df0aec3e tempest-ProjectMemberTests-1705931170 None] Creating offline snapshot c299aa79-98fd-4aad-bece-c28134dbed75 of volume b1386bbb-116a-4369-b325-0aa0fbdf60f5 {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:08:03 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e65703-1141-42f6-b18a-88a536abe6ae]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-54483e79-3927-45fc-b956-fed0df0aec3e tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:03 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5 Nov 04 19:08:03 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:04 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-54483e79-3927-45fc-b956-fed0df0aec3e tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5" returned: 0 in 0.403s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-54483e79-3927-45fc-b956-fed0df0aec3e tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5.c299aa79-98fd-4aad-bece-c28134dbed75 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:04 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5.c299aa79-98fd-4aad-bece-c28134dbed75 1G Nov 04 19:08:04 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:04 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-54483e79-3927-45fc-b956-fed0df0aec3e tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5.c299aa79-98fd-4aad-bece-c28134dbed75 1G" returned: 0 in 0.476s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-54483e79-3927-45fc-b956-fed0df0aec3e tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5.c299aa79-98fd-4aad-bece-c28134dbed75 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:04 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5.c299aa79-98fd-4aad-bece-c28134dbed75 Nov 04 19:08:04 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:04 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-54483e79-3927-45fc-b956-fed0df0aec3e tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5.c299aa79-98fd-4aad-bece-c28134dbed75" returned: 0 in 0.343s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:04 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-54483e79-3927-45fc-b956-fed0df0aec3e tempest-ProjectMemberTests-1705931170 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5.c299aa79-98fd-4aad-bece-c28134dbed75 is being set with open permissions: ugo+rw Nov 04 19:08:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-54483e79-3927-45fc-b956-fed0df0aec3e tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5.c299aa79-98fd-4aad-bece-c28134dbed75 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:04 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5.c299aa79-98fd-4aad-bece-c28134dbed75 Nov 04 19:08:04 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:05 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-54483e79-3927-45fc-b956-fed0df0aec3e tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5.c299aa79-98fd-4aad-bece-c28134dbed75" returned: 0 in 0.278s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-54483e79-3927-45fc-b956-fed0df0aec3e tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:05 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5.info Nov 04 19:08:05 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:05 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-54483e79-3927-45fc-b956-fed0df0aec3e tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5.info" returned: 0 in 0.287s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:05 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-54483e79-3927-45fc-b956-fed0df0aec3e tempest-ProjectMemberTests-1705931170 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5.info is being set with open permissions: ugo+rw Nov 04 19:08:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-54483e79-3927-45fc-b956-fed0df0aec3e tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:05 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5.info Nov 04 19:08:05 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:05 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-54483e79-3927-45fc-b956-fed0df0aec3e tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5.info" returned: 0 in 0.280s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-54483e79-3927-45fc-b956-fed0df0aec3e tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.184s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:05 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-54483e79-3927-45fc-b956-fed0df0aec3e tempest-ProjectMemberTests-1705931170 None] Create snapshot completed successfully Nov 04 19:08:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-abff7f27-7e93-4a7d-85fe-0e8b4bfcfd3c tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-c299aa79-98fd-4aad-bece-c28134dbed75-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-abff7f27-7e93-4a7d-85fe-0e8b4bfcfd3c tempest-ProjectMemberTests-1705931170 None] Lock "cinder-c299aa79-98fd-4aad-bece-c28134dbed75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-abff7f27-7e93-4a7d-85fe-0e8b4bfcfd3c tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-quobyte-b1386bbb-116a-4369-b325-0aa0fbdf60f5" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-abff7f27-7e93-4a7d-85fe-0e8b4bfcfd3c tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-b1386bbb-116a-4369-b325-0aa0fbdf60f5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-abff7f27-7e93-4a7d-85fe-0e8b4bfcfd3c tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-quobyte-c299aa79-98fd-4aad-bece-c28134dbed75" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:06 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-abff7f27-7e93-4a7d-85fe-0e8b4bfcfd3c tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-c299aa79-98fd-4aad-bece-c28134dbed75" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:06 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-abff7f27-7e93-4a7d-85fe-0e8b4bfcfd3c tempest-ProjectMemberTests-1705931170 None] Deleting offline snapshot c299aa79-98fd-4aad-bece-c28134dbed75 of volume b1386bbb-116a-4369-b325-0aa0fbdf60f5 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:08:06 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-abff7f27-7e93-4a7d-85fe-0e8b4bfcfd3c tempest-ProjectMemberTests-1705931170 None] snapshot_file for this snap is: volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5.c299aa79-98fd-4aad-bece-c28134dbed75 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:08:06 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2a6a25-313b-4446-aa40-51ecac9ecf24]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-abff7f27-7e93-4a7d-85fe-0e8b4bfcfd3c tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5.c299aa79-98fd-4aad-bece-c28134dbed75 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:07 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5.c299aa79-98fd-4aad-bece-c28134dbed75 Nov 04 19:08:07 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:07 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-abff7f27-7e93-4a7d-85fe-0e8b4bfcfd3c tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5.c299aa79-98fd-4aad-bece-c28134dbed75" returned: 0 in 0.427s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:07 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-abff7f27-7e93-4a7d-85fe-0e8b4bfcfd3c tempest-ProjectMemberTests-1705931170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:08:07 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9784a45-db76-4641-8331-eed7c32d2aa7]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-abff7f27-7e93-4a7d-85fe-0e8b4bfcfd3c tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:07 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5 Nov 04 19:08:07 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:07 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-abff7f27-7e93-4a7d-85fe-0e8b4bfcfd3c tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5" returned: 0 in 0.413s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-abff7f27-7e93-4a7d-85fe-0e8b4bfcfd3c tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5.c299aa79-98fd-4aad-bece-c28134dbed75 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:07 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5.c299aa79-98fd-4aad-bece-c28134dbed75 Nov 04 19:08:07 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:08 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-abff7f27-7e93-4a7d-85fe-0e8b4bfcfd3c tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5.c299aa79-98fd-4aad-bece-c28134dbed75" returned: 0 in 0.372s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-abff7f27-7e93-4a7d-85fe-0e8b4bfcfd3c tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5.c299aa79-98fd-4aad-bece-c28134dbed75 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:08 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5.c299aa79-98fd-4aad-bece-c28134dbed75 Nov 04 19:08:08 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:08 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-abff7f27-7e93-4a7d-85fe-0e8b4bfcfd3c tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5.c299aa79-98fd-4aad-bece-c28134dbed75" returned: 0 in 0.242s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-abff7f27-7e93-4a7d-85fe-0e8b4bfcfd3c tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-c299aa79-98fd-4aad-bece-c28134dbed75" released by "_delete_snapshot" :: held 1.594s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-abff7f27-7e93-4a7d-85fe-0e8b4bfcfd3c tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-b1386bbb-116a-4369-b325-0aa0fbdf60f5" released by "delete_snapshot" :: held 1.620s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:08 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-abff7f27-7e93-4a7d-85fe-0e8b4bfcfd3c tempest-ProjectMemberTests-1705931170 None] Created reservations ['1ef4114f-ad39-4076-ac6f-2217e267c0a0', 'b50970e8-0ed9-4c90-8927-f50b3a76e3d3', '55c587d2-906d-417d-86bc-8abd15644782', 'a6638d44-cc00-46de-9605-4510dcf129fc'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:08 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-abff7f27-7e93-4a7d-85fe-0e8b4bfcfd3c tempest-ProjectMemberTests-1705931170 None] Delete snapshot completed successfully. Nov 04 19:08:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-abff7f27-7e93-4a7d-85fe-0e8b4bfcfd3c tempest-ProjectMemberTests-1705931170 None] Lock "cinder-c299aa79-98fd-4aad-bece-c28134dbed75-delete_snapshot" released by "delete_snapshot" :: held 1.768s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-783fe486-057a-4dbb-91b9-9bb9a354db2a tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-b1386bbb-116a-4369-b325-0aa0fbdf60f5-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-783fe486-057a-4dbb-91b9-9bb9a354db2a tempest-ProjectMemberTests-1705931170 None] Lock "cinder-b1386bbb-116a-4369-b325-0aa0fbdf60f5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-783fe486-057a-4dbb-91b9-9bb9a354db2a tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-quobyte-b1386bbb-116a-4369-b325-0aa0fbdf60f5" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-783fe486-057a-4dbb-91b9-9bb9a354db2a tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-b1386bbb-116a-4369-b325-0aa0fbdf60f5" acquired by "delete_volume" :: waited 0.015s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:09 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[def877dc-8bf3-4dfd-a581-ef9ec5d467e5]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-783fe486-057a-4dbb-91b9-9bb9a354db2a tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:09 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5 Nov 04 19:08:09 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:09 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-783fe486-057a-4dbb-91b9-9bb9a354db2a tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5" returned: 0 in 0.372s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-783fe486-057a-4dbb-91b9-9bb9a354db2a tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:09 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5 Nov 04 19:08:09 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:09 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-783fe486-057a-4dbb-91b9-9bb9a354db2a tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-b1386bbb-116a-4369-b325-0aa0fbdf60f5" returned: 0 in 0.252s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:09 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-783fe486-057a-4dbb-91b9-9bb9a354db2a tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-b1386bbb-116a-4369-b325-0aa0fbdf60f5" released by "delete_volume" :: held 0.683s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:09 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-783fe486-057a-4dbb-91b9-9bb9a354db2a tempest-ProjectMemberTests-1705931170 None] Created reservations ['e08b1fd4-5d00-49d0-8006-b03e34078c0e', '8bc51213-9bb3-4d2c-b23b-b893ac39fadb', 'fae99536-6650-40d8-bb49-a64a45a34da5', '0988851a-1051-488c-b6ce-94870bfa6180'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-783fe486-057a-4dbb-91b9-9bb9a354db2a tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-783fe486-057a-4dbb-91b9-9bb9a354db2a tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-783fe486-057a-4dbb-91b9-9bb9a354db2a tempest-ProjectMemberTests-1705931170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-783fe486-057a-4dbb-91b9-9bb9a354db2a tempest-ProjectMemberTests-1705931170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-783fe486-057a-4dbb-91b9-9bb9a354db2a tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-783fe486-057a-4dbb-91b9-9bb9a354db2a tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:09 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:08:09 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:10 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-783fe486-057a-4dbb-91b9-9bb9a354db2a tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.254s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:10 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-783fe486-057a-4dbb-91b9-9bb9a354db2a tempest-ProjectMemberTests-1705931170 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:10 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-783fe486-057a-4dbb-91b9-9bb9a354db2a tempest-ProjectMemberTests-1705931170 None] Deleted volume successfully. Nov 04 19:08:10 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-783fe486-057a-4dbb-91b9-9bb9a354db2a tempest-ProjectMemberTests-1705931170 None] Lock "cinder-b1386bbb-116a-4369-b325-0aa0fbdf60f5-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:10 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:08:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Flow 'volume_create_manager' (6374bcf7-6488-4346-aa59-d8459c583345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f41063f-005b-4f3d-bfc7-0d658fdc2207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f41063f-005b-4f3d-bfc7-0d658fdc2207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1784751799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=896a040a-7f39-42fa-ad0b-e4f238eaa464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eea4506f7224002863cfaf3510e93b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:11Z,use_quota=True,user_id='cd1b5ab70cb74972a3562eb0a2e88be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4af9a0-e4dd-462a-8733-4b68c3413924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4af9a0-e4dd-462a-8733-4b68c3413924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67eff91e-2ebb-432b-b2e5-3629ad908074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67eff91e-2ebb-432b-b2e5-3629ad908074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '896a040a-7f39-42fa-ad0b-e4f238eaa464', 'volume_name': 'volume-896a040a-7f39-42fa-ad0b-e4f238eaa464', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4150b32-85ea-4f96-a5eb-9d0bb0b5d718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4150b32-85ea-4f96-a5eb-9d0bb0b5d718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f80133-c040-4611-80ed-12a8b710062f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:10 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Volume 896a040a-7f39-42fa-ad0b-e4f238eaa464: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-896a040a-7f39-42fa-ad0b-e4f238eaa464', 'volume_size': 1} Nov 04 19:08:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1784751799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=896a040a-7f39-42fa-ad0b-e4f238eaa464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eea4506f7224002863cfaf3510e93b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:11Z,use_quota=True,user_id='cd1b5ab70cb74972a3562eb0a2e88be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:08:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Creating volume 896a040a-7f39-42fa-ad0b-e4f238eaa464 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:08:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:08:10 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:08:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:10 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464 1073741824 Nov 04 19:08:10 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:11 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464 1073741824" returned: 0 in 0.415s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:11 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464 Nov 04 19:08:11 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:11 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464" returned: 0 in 0.254s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:11 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:08:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f80133-c040-4611-80ed-12a8b710062f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-896a040a-7f39-42fa-ad0b-e4f238eaa464', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (846ce58f-c203-4717-9793-00c8ed08cafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:11 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Volume volume-896a040a-7f39-42fa-ad0b-e4f238eaa464 (896a040a-7f39-42fa-ad0b-e4f238eaa464): created successfully Nov 04 19:08:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (846ce58f-c203-4717-9793-00c8ed08cafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:11 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Flow 'volume_create_manager' (6374bcf7-6488-4346-aa59-d8459c583345) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:11 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-f3eb43d8-da2f-4f02-a35e-e71e52fdef86 tempest-ProjectMemberTests-1705931170 None] Created volume successfully. Nov 04 19:08:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-267398ef-2c73-442a-bc7c-8e7eb00af4fd tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-267398ef-2c73-442a-bc7c-8e7eb00af4fd tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:11 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-267398ef-2c73-442a-bc7c-8e7eb00af4fd tempest-ProjectMemberTests-1705931170 None] Creating offline snapshot 7af90b5a-0528-4049-b2fe-916970dd670d of volume 896a040a-7f39-42fa-ad0b-e4f238eaa464 {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:08:11 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c698d7c4-bcf7-4f02-909c-c57f8b9296ea]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-267398ef-2c73-442a-bc7c-8e7eb00af4fd tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:11 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464 Nov 04 19:08:11 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:12 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-267398ef-2c73-442a-bc7c-8e7eb00af4fd tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464" returned: 0 in 0.399s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-267398ef-2c73-442a-bc7c-8e7eb00af4fd tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464.7af90b5a-0528-4049-b2fe-916970dd670d 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:12 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464.7af90b5a-0528-4049-b2fe-916970dd670d 1G Nov 04 19:08:12 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:12 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-267398ef-2c73-442a-bc7c-8e7eb00af4fd tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464.7af90b5a-0528-4049-b2fe-916970dd670d 1G" returned: 0 in 0.431s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-267398ef-2c73-442a-bc7c-8e7eb00af4fd tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-896a040a-7f39-42fa-ad0b-e4f238eaa464 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464.7af90b5a-0528-4049-b2fe-916970dd670d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:12 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-896a040a-7f39-42fa-ad0b-e4f238eaa464 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464.7af90b5a-0528-4049-b2fe-916970dd670d Nov 04 19:08:12 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:12 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-267398ef-2c73-442a-bc7c-8e7eb00af4fd tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-896a040a-7f39-42fa-ad0b-e4f238eaa464 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464.7af90b5a-0528-4049-b2fe-916970dd670d" returned: 0 in 0.290s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:12 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-267398ef-2c73-442a-bc7c-8e7eb00af4fd tempest-ProjectMemberTests-1705931170 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464.7af90b5a-0528-4049-b2fe-916970dd670d is being set with open permissions: ugo+rw Nov 04 19:08:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-267398ef-2c73-442a-bc7c-8e7eb00af4fd tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464.7af90b5a-0528-4049-b2fe-916970dd670d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:12 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464.7af90b5a-0528-4049-b2fe-916970dd670d Nov 04 19:08:13 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:13 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-267398ef-2c73-442a-bc7c-8e7eb00af4fd tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464.7af90b5a-0528-4049-b2fe-916970dd670d" returned: 0 in 0.259s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-267398ef-2c73-442a-bc7c-8e7eb00af4fd tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:13 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464.info Nov 04 19:08:13 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:13 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-267398ef-2c73-442a-bc7c-8e7eb00af4fd tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464.info" returned: 0 in 0.292s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:13 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-267398ef-2c73-442a-bc7c-8e7eb00af4fd tempest-ProjectMemberTests-1705931170 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464.info is being set with open permissions: ugo+rw Nov 04 19:08:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-267398ef-2c73-442a-bc7c-8e7eb00af4fd tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:13 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464.info Nov 04 19:08:13 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:13 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-267398ef-2c73-442a-bc7c-8e7eb00af4fd tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464.info" returned: 0 in 0.260s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-267398ef-2c73-442a-bc7c-8e7eb00af4fd tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.042s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:13 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-267398ef-2c73-442a-bc7c-8e7eb00af4fd tempest-ProjectMemberTests-1705931170 None] Create snapshot completed successfully Nov 04 19:08:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-96aa4c79-ffdc-4912-a1bf-9517cfeedaad tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-7af90b5a-0528-4049-b2fe-916970dd670d-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-96aa4c79-ffdc-4912-a1bf-9517cfeedaad tempest-ProjectMemberTests-1705931170 None] Lock "cinder-7af90b5a-0528-4049-b2fe-916970dd670d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-96aa4c79-ffdc-4912-a1bf-9517cfeedaad tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-quobyte-896a040a-7f39-42fa-ad0b-e4f238eaa464" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-96aa4c79-ffdc-4912-a1bf-9517cfeedaad tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-896a040a-7f39-42fa-ad0b-e4f238eaa464" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-96aa4c79-ffdc-4912-a1bf-9517cfeedaad tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-quobyte-7af90b5a-0528-4049-b2fe-916970dd670d" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:15 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-96aa4c79-ffdc-4912-a1bf-9517cfeedaad tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-7af90b5a-0528-4049-b2fe-916970dd670d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:15 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-96aa4c79-ffdc-4912-a1bf-9517cfeedaad tempest-ProjectMemberTests-1705931170 None] Deleting offline snapshot 7af90b5a-0528-4049-b2fe-916970dd670d of volume 896a040a-7f39-42fa-ad0b-e4f238eaa464 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:08:15 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-96aa4c79-ffdc-4912-a1bf-9517cfeedaad tempest-ProjectMemberTests-1705931170 None] snapshot_file for this snap is: volume-896a040a-7f39-42fa-ad0b-e4f238eaa464.7af90b5a-0528-4049-b2fe-916970dd670d {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:08:15 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6aa7287-05e4-4eb3-9775-7e2f5e884d89]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-96aa4c79-ffdc-4912-a1bf-9517cfeedaad tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464.7af90b5a-0528-4049-b2fe-916970dd670d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:15 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464.7af90b5a-0528-4049-b2fe-916970dd670d Nov 04 19:08:15 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:15 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-96aa4c79-ffdc-4912-a1bf-9517cfeedaad tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464.7af90b5a-0528-4049-b2fe-916970dd670d" returned: 0 in 0.404s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:15 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-96aa4c79-ffdc-4912-a1bf-9517cfeedaad tempest-ProjectMemberTests-1705931170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-896a040a-7f39-42fa-ad0b-e4f238eaa464(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:08:15 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d903934a-39a0-4a45-882c-b1b2b81219c0]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-96aa4c79-ffdc-4912-a1bf-9517cfeedaad tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:15 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464 Nov 04 19:08:15 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:15 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-96aa4c79-ffdc-4912-a1bf-9517cfeedaad tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464" returned: 0 in 0.381s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-96aa4c79-ffdc-4912-a1bf-9517cfeedaad tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464.7af90b5a-0528-4049-b2fe-916970dd670d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:15 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464.7af90b5a-0528-4049-b2fe-916970dd670d Nov 04 19:08:15 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:16 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-96aa4c79-ffdc-4912-a1bf-9517cfeedaad tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464.7af90b5a-0528-4049-b2fe-916970dd670d" returned: 0 in 0.358s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-96aa4c79-ffdc-4912-a1bf-9517cfeedaad tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464.7af90b5a-0528-4049-b2fe-916970dd670d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:16 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464.7af90b5a-0528-4049-b2fe-916970dd670d Nov 04 19:08:16 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:16 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-96aa4c79-ffdc-4912-a1bf-9517cfeedaad tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464.7af90b5a-0528-4049-b2fe-916970dd670d" returned: 0 in 0.274s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:16 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-96aa4c79-ffdc-4912-a1bf-9517cfeedaad tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-7af90b5a-0528-4049-b2fe-916970dd670d" released by "_delete_snapshot" :: held 1.545s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:16 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-96aa4c79-ffdc-4912-a1bf-9517cfeedaad tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-896a040a-7f39-42fa-ad0b-e4f238eaa464" released by "delete_snapshot" :: held 1.570s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:16 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-96aa4c79-ffdc-4912-a1bf-9517cfeedaad tempest-ProjectMemberTests-1705931170 None] Created reservations ['4f6d728f-ade4-47c5-8e33-194861e52f86', '264abdde-cc27-4562-9f30-439f73ac6fa0', '5edd53be-906b-482b-9b42-3cf38768055b', 'f94663dd-28b6-4ed0-97fb-b31bc9e7bb70'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:16 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-96aa4c79-ffdc-4912-a1bf-9517cfeedaad tempest-ProjectMemberTests-1705931170 None] Delete snapshot completed successfully. Nov 04 19:08:16 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-96aa4c79-ffdc-4912-a1bf-9517cfeedaad tempest-ProjectMemberTests-1705931170 None] Lock "cinder-7af90b5a-0528-4049-b2fe-916970dd670d-delete_snapshot" released by "delete_snapshot" :: held 1.711s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:17 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e25e5ef9-1c46-4d47-8740-ad3425ec9476 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-896a040a-7f39-42fa-ad0b-e4f238eaa464-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:17 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e25e5ef9-1c46-4d47-8740-ad3425ec9476 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-896a040a-7f39-42fa-ad0b-e4f238eaa464-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:17 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e25e5ef9-1c46-4d47-8740-ad3425ec9476 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-quobyte-896a040a-7f39-42fa-ad0b-e4f238eaa464" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:17 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e25e5ef9-1c46-4d47-8740-ad3425ec9476 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-896a040a-7f39-42fa-ad0b-e4f238eaa464" acquired by "delete_volume" :: waited 0.022s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:17 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f925f79f-0ac2-4f48-bfec-1758e93e7ead]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e25e5ef9-1c46-4d47-8740-ad3425ec9476 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:17 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464 Nov 04 19:08:17 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:17 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e25e5ef9-1c46-4d47-8740-ad3425ec9476 tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464" returned: 0 in 0.495s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e25e5ef9-1c46-4d47-8740-ad3425ec9476 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:17 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464 Nov 04 19:08:17 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:18 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e25e5ef9-1c46-4d47-8740-ad3425ec9476 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-896a040a-7f39-42fa-ad0b-e4f238eaa464" returned: 0 in 0.241s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e25e5ef9-1c46-4d47-8740-ad3425ec9476 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-896a040a-7f39-42fa-ad0b-e4f238eaa464" released by "delete_volume" :: held 0.818s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-e25e5ef9-1c46-4d47-8740-ad3425ec9476 tempest-ProjectMemberTests-1705931170 None] Created reservations ['509fa7ec-f3de-469e-b85c-0448d4e8d73d', 'f022bfd1-6e6d-40a5-8449-58be97c1c8a1', '0422adc9-b8e7-4fca-82b4-b5847299cdc3', '2e51d6fd-15f4-4802-a003-5aedabbde969'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e25e5ef9-1c46-4d47-8740-ad3425ec9476 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e25e5ef9-1c46-4d47-8740-ad3425ec9476 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e25e5ef9-1c46-4d47-8740-ad3425ec9476 tempest-ProjectMemberTests-1705931170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e25e5ef9-1c46-4d47-8740-ad3425ec9476 tempest-ProjectMemberTests-1705931170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e25e5ef9-1c46-4d47-8740-ad3425ec9476 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e25e5ef9-1c46-4d47-8740-ad3425ec9476 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:18 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:08:18 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:18 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e25e5ef9-1c46-4d47-8740-ad3425ec9476 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.258s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-e25e5ef9-1c46-4d47-8740-ad3425ec9476 tempest-ProjectMemberTests-1705931170 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:18 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e25e5ef9-1c46-4d47-8740-ad3425ec9476 tempest-ProjectMemberTests-1705931170 None] Deleted volume successfully. Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e25e5ef9-1c46-4d47-8740-ad3425ec9476 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-896a040a-7f39-42fa-ad0b-e4f238eaa464-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Flow 'volume_create_manager' (c3caf2b2-b3d1-4206-8cef-a28813136e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e1e479-6ed3-4fff-89c1-c89dfab78343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e1e479-6ed3-4fff-89c1-c89dfab78343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1730497622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea29b0ab-fee8-4b74-b996-7df4381801f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eea4506f7224002863cfaf3510e93b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:19Z,use_quota=True,user_id='cd1b5ab70cb74972a3562eb0a2e88be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3199b4-cad7-4f61-bfb1-96de52b81b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3199b4-cad7-4f61-bfb1-96de52b81b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d02191-c6e2-4df0-9079-672dd2133b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d02191-c6e2-4df0-9079-672dd2133b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea29b0ab-fee8-4b74-b996-7df4381801f9', 'volume_name': 'volume-ea29b0ab-fee8-4b74-b996-7df4381801f9', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe5f092-9041-4d28-8c24-b0a7fde5a997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe5f092-9041-4d28-8c24-b0a7fde5a997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93406e37-c906-4fbb-972f-2d5e24a39749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:18 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Volume ea29b0ab-fee8-4b74-b996-7df4381801f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea29b0ab-fee8-4b74-b996-7df4381801f9', 'volume_size': 1} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1730497622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea29b0ab-fee8-4b74-b996-7df4381801f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eea4506f7224002863cfaf3510e93b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:19Z,use_quota=True,user_id='cd1b5ab70cb74972a3562eb0a2e88be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Creating volume ea29b0ab-fee8-4b74-b996-7df4381801f9 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:08:18 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:08:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:18 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9 1073741824 Nov 04 19:08:18 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:19 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9 1073741824" returned: 0 in 0.449s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:19 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9 Nov 04 19:08:19 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:19 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9" returned: 0 in 0.273s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:19 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:08:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:19 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93406e37-c906-4fbb-972f-2d5e24a39749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea29b0ab-fee8-4b74-b996-7df4381801f9', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:19 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e49ab1f1-af7e-49fc-b144-fffe7359d5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:19 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Volume volume-ea29b0ab-fee8-4b74-b996-7df4381801f9 (ea29b0ab-fee8-4b74-b996-7df4381801f9): created successfully Nov 04 19:08:19 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e49ab1f1-af7e-49fc-b144-fffe7359d5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:19 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Flow 'volume_create_manager' (c3caf2b2-b3d1-4206-8cef-a28813136e68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:19 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-66fa5bb2-0f7b-4042-9dbc-34905c950da6 tempest-ProjectMemberTests-1705931170 None] Created volume successfully. Nov 04 19:08:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6fa22fd7-7147-47e1-b8b0-bec56499f14b tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6fa22fd7-7147-47e1-b8b0-bec56499f14b tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:21 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-6fa22fd7-7147-47e1-b8b0-bec56499f14b tempest-ProjectMemberTests-1705931170 None] Creating offline snapshot 6c8fe42e-258c-4a64-a441-d5c361dea703 of volume ea29b0ab-fee8-4b74-b996-7df4381801f9 {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:08:21 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0686e34-9ef3-417c-bace-59ef4859ace8]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6fa22fd7-7147-47e1-b8b0-bec56499f14b tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:21 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9 Nov 04 19:08:21 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:21 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6fa22fd7-7147-47e1-b8b0-bec56499f14b tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9" returned: 0 in 0.434s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6fa22fd7-7147-47e1-b8b0-bec56499f14b tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9.6c8fe42e-258c-4a64-a441-d5c361dea703 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:21 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9.6c8fe42e-258c-4a64-a441-d5c361dea703 1G Nov 04 19:08:21 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:22 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6fa22fd7-7147-47e1-b8b0-bec56499f14b tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9.6c8fe42e-258c-4a64-a441-d5c361dea703 1G" returned: 0 in 0.463s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6fa22fd7-7147-47e1-b8b0-bec56499f14b tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea29b0ab-fee8-4b74-b996-7df4381801f9 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9.6c8fe42e-258c-4a64-a441-d5c361dea703 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:22 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea29b0ab-fee8-4b74-b996-7df4381801f9 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9.6c8fe42e-258c-4a64-a441-d5c361dea703 Nov 04 19:08:22 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:22 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6fa22fd7-7147-47e1-b8b0-bec56499f14b tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea29b0ab-fee8-4b74-b996-7df4381801f9 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9.6c8fe42e-258c-4a64-a441-d5c361dea703" returned: 0 in 0.365s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:22 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-6fa22fd7-7147-47e1-b8b0-bec56499f14b tempest-ProjectMemberTests-1705931170 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9.6c8fe42e-258c-4a64-a441-d5c361dea703 is being set with open permissions: ugo+rw Nov 04 19:08:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6fa22fd7-7147-47e1-b8b0-bec56499f14b tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9.6c8fe42e-258c-4a64-a441-d5c361dea703 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:22 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9.6c8fe42e-258c-4a64-a441-d5c361dea703 Nov 04 19:08:22 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:22 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6fa22fd7-7147-47e1-b8b0-bec56499f14b tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9.6c8fe42e-258c-4a64-a441-d5c361dea703" returned: 0 in 0.261s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6fa22fd7-7147-47e1-b8b0-bec56499f14b tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:22 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9.info Nov 04 19:08:22 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:22 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6fa22fd7-7147-47e1-b8b0-bec56499f14b tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9.info" returned: 0 in 0.246s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:22 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-6fa22fd7-7147-47e1-b8b0-bec56499f14b tempest-ProjectMemberTests-1705931170 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9.info is being set with open permissions: ugo+rw Nov 04 19:08:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6fa22fd7-7147-47e1-b8b0-bec56499f14b tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:22 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9.info Nov 04 19:08:22 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:23 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-6fa22fd7-7147-47e1-b8b0-bec56499f14b tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9.info" returned: 0 in 0.269s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-6fa22fd7-7147-47e1-b8b0-bec56499f14b tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.124s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:23 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-6fa22fd7-7147-47e1-b8b0-bec56499f14b tempest-ProjectMemberTests-1705931170 None] Create snapshot completed successfully Nov 04 19:08:24 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7eaf086b-23ef-4bdf-8621-a82f371b7b96 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-6c8fe42e-258c-4a64-a441-d5c361dea703-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:24 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7eaf086b-23ef-4bdf-8621-a82f371b7b96 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-6c8fe42e-258c-4a64-a441-d5c361dea703-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:24 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7eaf086b-23ef-4bdf-8621-a82f371b7b96 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-quobyte-ea29b0ab-fee8-4b74-b996-7df4381801f9" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:24 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7eaf086b-23ef-4bdf-8621-a82f371b7b96 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-ea29b0ab-fee8-4b74-b996-7df4381801f9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:24 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7eaf086b-23ef-4bdf-8621-a82f371b7b96 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-quobyte-6c8fe42e-258c-4a64-a441-d5c361dea703" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:24 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7eaf086b-23ef-4bdf-8621-a82f371b7b96 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-6c8fe42e-258c-4a64-a441-d5c361dea703" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:24 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-7eaf086b-23ef-4bdf-8621-a82f371b7b96 tempest-ProjectMemberTests-1705931170 None] Deleting offline snapshot 6c8fe42e-258c-4a64-a441-d5c361dea703 of volume ea29b0ab-fee8-4b74-b996-7df4381801f9 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:08:24 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-7eaf086b-23ef-4bdf-8621-a82f371b7b96 tempest-ProjectMemberTests-1705931170 None] snapshot_file for this snap is: volume-ea29b0ab-fee8-4b74-b996-7df4381801f9.6c8fe42e-258c-4a64-a441-d5c361dea703 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:08:24 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c26e90-6084-485f-850c-4b6cba7dfa9f]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eaf086b-23ef-4bdf-8621-a82f371b7b96 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9.6c8fe42e-258c-4a64-a441-d5c361dea703 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:24 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9.6c8fe42e-258c-4a64-a441-d5c361dea703 Nov 04 19:08:24 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:24 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eaf086b-23ef-4bdf-8621-a82f371b7b96 tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9.6c8fe42e-258c-4a64-a441-d5c361dea703" returned: 0 in 0.416s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:24 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-7eaf086b-23ef-4bdf-8621-a82f371b7b96 tempest-ProjectMemberTests-1705931170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea29b0ab-fee8-4b74-b996-7df4381801f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:08:24 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91a9359-23c1-4fb7-a57d-f06e1a922af9]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:24 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eaf086b-23ef-4bdf-8621-a82f371b7b96 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:24 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9 Nov 04 19:08:24 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:25 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eaf086b-23ef-4bdf-8621-a82f371b7b96 tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9" returned: 0 in 0.377s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eaf086b-23ef-4bdf-8621-a82f371b7b96 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9.6c8fe42e-258c-4a64-a441-d5c361dea703 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:25 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9.6c8fe42e-258c-4a64-a441-d5c361dea703 Nov 04 19:08:25 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager._thread_info {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:08:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread count: 28 {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:08:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread info: [<_MainThread(MainThread, started 130247852032128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:08:25 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eaf086b-23ef-4bdf-8621-a82f371b7b96 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9.6c8fe42e-258c-4a64-a441-d5c361dea703" returned: 0 in 0.358s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eaf086b-23ef-4bdf-8621-a82f371b7b96 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9.6c8fe42e-258c-4a64-a441-d5c361dea703 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:25 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9.6c8fe42e-258c-4a64-a441-d5c361dea703 Nov 04 19:08:25 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:25 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7eaf086b-23ef-4bdf-8621-a82f371b7b96 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9.6c8fe42e-258c-4a64-a441-d5c361dea703" returned: 0 in 0.259s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:25 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7eaf086b-23ef-4bdf-8621-a82f371b7b96 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-6c8fe42e-258c-4a64-a441-d5c361dea703" released by "_delete_snapshot" :: held 1.523s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:25 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7eaf086b-23ef-4bdf-8621-a82f371b7b96 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-ea29b0ab-fee8-4b74-b996-7df4381801f9" released by "delete_snapshot" :: held 1.553s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:25 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-7eaf086b-23ef-4bdf-8621-a82f371b7b96 tempest-ProjectMemberTests-1705931170 None] Created reservations ['f1c993a2-fece-4e47-b2fa-e500dc576f5c', 'b89f302a-2ad2-4331-90c5-dfb430179a27', '5783ce18-7062-41ea-8cd5-d9b31b388c77', 'f1f84569-69a8-409e-ab71-9b0234ee3906'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:26 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-7eaf086b-23ef-4bdf-8621-a82f371b7b96 tempest-ProjectMemberTests-1705931170 None] Delete snapshot completed successfully. Nov 04 19:08:26 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7eaf086b-23ef-4bdf-8621-a82f371b7b96 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-6c8fe42e-258c-4a64-a441-d5c361dea703-delete_snapshot" released by "delete_snapshot" :: held 1.694s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:26 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-41059207-f431-4131-8ff5-4ab55f009bba tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-ea29b0ab-fee8-4b74-b996-7df4381801f9-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:26 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-41059207-f431-4131-8ff5-4ab55f009bba tempest-ProjectMemberTests-1705931170 None] Lock "cinder-ea29b0ab-fee8-4b74-b996-7df4381801f9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:26 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-41059207-f431-4131-8ff5-4ab55f009bba tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-quobyte-ea29b0ab-fee8-4b74-b996-7df4381801f9" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:26 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-41059207-f431-4131-8ff5-4ab55f009bba tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-ea29b0ab-fee8-4b74-b996-7df4381801f9" acquired by "delete_volume" :: waited 0.028s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:26 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e925ed-dbb6-4c7f-8376-87fd9acb078c]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:26 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-41059207-f431-4131-8ff5-4ab55f009bba tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:26 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9 Nov 04 19:08:26 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:27 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-41059207-f431-4131-8ff5-4ab55f009bba tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9" returned: 0 in 0.374s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-41059207-f431-4131-8ff5-4ab55f009bba tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:27 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9 Nov 04 19:08:27 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:27 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-41059207-f431-4131-8ff5-4ab55f009bba tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-ea29b0ab-fee8-4b74-b996-7df4381801f9" returned: 0 in 0.242s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:27 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-41059207-f431-4131-8ff5-4ab55f009bba tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-ea29b0ab-fee8-4b74-b996-7df4381801f9" released by "delete_volume" :: held 0.701s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:27 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-41059207-f431-4131-8ff5-4ab55f009bba tempest-ProjectMemberTests-1705931170 None] Created reservations ['413d0753-b158-43c9-9c15-39dbbb462b20', '9d3d583a-ef7f-418b-9d37-24c144e6a75f', '3338dde9-54f7-417c-b9ac-3f75826a10f1', 'cf034d43-ca5c-4050-b6b5-b438879f8c40'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-41059207-f431-4131-8ff5-4ab55f009bba tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-41059207-f431-4131-8ff5-4ab55f009bba tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:27 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-41059207-f431-4131-8ff5-4ab55f009bba tempest-ProjectMemberTests-1705931170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:27 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-41059207-f431-4131-8ff5-4ab55f009bba tempest-ProjectMemberTests-1705931170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-41059207-f431-4131-8ff5-4ab55f009bba tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-41059207-f431-4131-8ff5-4ab55f009bba tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:27 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:08:27 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:27 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:27 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-41059207-f431-4131-8ff5-4ab55f009bba tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.344s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:27 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-41059207-f431-4131-8ff5-4ab55f009bba tempest-ProjectMemberTests-1705931170 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:27 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-41059207-f431-4131-8ff5-4ab55f009bba tempest-ProjectMemberTests-1705931170 None] Deleted volume successfully. Nov 04 19:08:27 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-41059207-f431-4131-8ff5-4ab55f009bba tempest-ProjectMemberTests-1705931170 None] Lock "cinder-ea29b0ab-fee8-4b74-b996-7df4381801f9-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:28 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:08:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Flow 'volume_create_manager' (0b0dc9cd-d061-44ef-b7ac-3805e56fa1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e690bbf0-cb00-4163-85c5-0d0799c52750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e690bbf0-cb00-4163-85c5-0d0799c52750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1259449701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b955c1-a50c-45c0-ae2a-d10d82f17832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eea4506f7224002863cfaf3510e93b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:28Z,use_quota=True,user_id='cd1b5ab70cb74972a3562eb0a2e88be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b4193f-9b94-4d0d-bd28-4b00afc2c1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b4193f-9b94-4d0d-bd28-4b00afc2c1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af099035-51bb-441d-af20-3679b826cb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af099035-51bb-441d-af20-3679b826cb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2b955c1-a50c-45c0-ae2a-d10d82f17832', 'volume_name': 'volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abca9a51-d0c0-4ce9-93c9-ba9f69aaea18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abca9a51-d0c0-4ce9-93c9-ba9f69aaea18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:28 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5729a0-a51c-4ce6-b86d-2a014c477d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:28 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Volume f2b955c1-a50c-45c0-ae2a-d10d82f17832: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832', 'volume_size': 1} Nov 04 19:08:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1259449701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b955c1-a50c-45c0-ae2a-d10d82f17832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eea4506f7224002863cfaf3510e93b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:28Z,use_quota=True,user_id='cd1b5ab70cb74972a3562eb0a2e88be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:08:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Creating volume f2b955c1-a50c-45c0-ae2a-d10d82f17832 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:08:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:28 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:08:28 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:08:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:28 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832 1073741824 Nov 04 19:08:28 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:28 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832 1073741824" returned: 0 in 0.556s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:28 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:28 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832 Nov 04 19:08:28 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:29 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832" returned: 0 in 0.263s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:29 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:08:29 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5729a0-a51c-4ce6-b86d-2a014c477d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2373406-9b6e-4b43-a4fe-54162ff275a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:29 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Volume volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832 (f2b955c1-a50c-45c0-ae2a-d10d82f17832): created successfully Nov 04 19:08:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2373406-9b6e-4b43-a4fe-54162ff275a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:29 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Flow 'volume_create_manager' (0b0dc9cd-d061-44ef-b7ac-3805e56fa1e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:29 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-bbcec2ca-a966-4b30-a0fe-7d8f57c9d13f tempest-ProjectMemberTests-1705931170 None] Created volume successfully. Nov 04 19:08:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2a82b2a2-378d-4ac9-83f6-9d0c5cc10339 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2a82b2a2-378d-4ac9-83f6-9d0c5cc10339 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:30 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-2a82b2a2-378d-4ac9-83f6-9d0c5cc10339 tempest-ProjectMemberTests-1705931170 None] Creating offline snapshot 8cb0ff0d-ac57-4897-89a0-531d09086c7d of volume f2b955c1-a50c-45c0-ae2a-d10d82f17832 {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:08:30 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd282d4a-e12f-41e7-859a-74e123d96bc0]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2a82b2a2-378d-4ac9-83f6-9d0c5cc10339 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:30 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832 Nov 04 19:08:30 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:30 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2a82b2a2-378d-4ac9-83f6-9d0c5cc10339 tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832" returned: 0 in 0.412s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:30 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2a82b2a2-378d-4ac9-83f6-9d0c5cc10339 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832.8cb0ff0d-ac57-4897-89a0-531d09086c7d 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:31 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832.8cb0ff0d-ac57-4897-89a0-531d09086c7d 1G Nov 04 19:08:31 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:31 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2a82b2a2-378d-4ac9-83f6-9d0c5cc10339 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832.8cb0ff0d-ac57-4897-89a0-531d09086c7d 1G" returned: 0 in 0.570s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2a82b2a2-378d-4ac9-83f6-9d0c5cc10339 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832.8cb0ff0d-ac57-4897-89a0-531d09086c7d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:31 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832.8cb0ff0d-ac57-4897-89a0-531d09086c7d Nov 04 19:08:31 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:31 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2a82b2a2-378d-4ac9-83f6-9d0c5cc10339 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832.8cb0ff0d-ac57-4897-89a0-531d09086c7d" returned: 0 in 0.363s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:31 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-2a82b2a2-378d-4ac9-83f6-9d0c5cc10339 tempest-ProjectMemberTests-1705931170 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832.8cb0ff0d-ac57-4897-89a0-531d09086c7d is being set with open permissions: ugo+rw Nov 04 19:08:31 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2a82b2a2-378d-4ac9-83f6-9d0c5cc10339 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832.8cb0ff0d-ac57-4897-89a0-531d09086c7d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:31 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832.8cb0ff0d-ac57-4897-89a0-531d09086c7d Nov 04 19:08:31 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:32 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2a82b2a2-378d-4ac9-83f6-9d0c5cc10339 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832.8cb0ff0d-ac57-4897-89a0-531d09086c7d" returned: 0 in 0.237s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2a82b2a2-378d-4ac9-83f6-9d0c5cc10339 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:32 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832.info Nov 04 19:08:32 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:32 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:08:32 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Flow 'volume_create_manager' (e97fe9b1-1a4e-4d3f-a8df-65d082ebcdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4812934a-c05e-4ce3-b571-c723acb8100f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2a82b2a2-378d-4ac9-83f6-9d0c5cc10339 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832.info" returned: 0 in 0.310s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:32 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-2a82b2a2-378d-4ac9-83f6-9d0c5cc10339 tempest-ProjectMemberTests-1705931170 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832.info is being set with open permissions: ugo+rw Nov 04 19:08:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2a82b2a2-378d-4ac9-83f6-9d0c5cc10339 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4812934a-c05e-4ce3-b571-c723acb8100f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1667188000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4489b301-2e47-47bd-93a7-90224822f2bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f97a8acc4cb459d8ba221e3cbcf3100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:32Z,use_quota=True,user_id='f44481f57ed141c7aa8dab5f3c29e6c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:32 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832.info Nov 04 19:08:32 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (802b199c-3a16-4d6f-8626-b4af9a29450d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (802b199c-3a16-4d6f-8626-b4af9a29450d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273c46ae-cfe7-4a27-a69a-1568331865be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273c46ae-cfe7-4a27-a69a-1568331865be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4489b301-2e47-47bd-93a7-90224822f2bf', 'volume_name': 'volume-4489b301-2e47-47bd-93a7-90224822f2bf', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea8975a-9628-4672-8f74-b014e9358d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea8975a-9628-4672-8f74-b014e9358d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:32 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a6638d-0bf1-4c43-8773-b6f67dd9b7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:32 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Volume 4489b301-2e47-47bd-93a7-90224822f2bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4489b301-2e47-47bd-93a7-90224822f2bf', 'volume_size': 1} Nov 04 19:08:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:32 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2a82b2a2-378d-4ac9-83f6-9d0c5cc10339 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832.info" returned: 0 in 0.232s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2a82b2a2-378d-4ac9-83f6-9d0c5cc10339 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.214s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.186s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1667188000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4489b301-2e47-47bd-93a7-90224822f2bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f97a8acc4cb459d8ba221e3cbcf3100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:32Z,use_quota=True,user_id='f44481f57ed141c7aa8dab5f3c29e6c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:08:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Creating volume 4489b301-2e47-47bd-93a7-90224822f2bf {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:08:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:32 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:08:32 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:08:32 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:32 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf 1073741824 Nov 04 19:08:32 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:32 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-2a82b2a2-378d-4ac9-83f6-9d0c5cc10339 tempest-ProjectMemberTests-1705931170 None] Create snapshot completed successfully Nov 04 19:08:33 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf 1073741824" returned: 0 in 0.410s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:33 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf Nov 04 19:08:33 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:33 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf" returned: 0 in 0.255s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:08:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a6638d-0bf1-4c43-8773-b6f67dd9b7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4489b301-2e47-47bd-93a7-90224822f2bf', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f08bacf-adb1-46da-bc5b-b670e4c6127c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:33 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Volume volume-4489b301-2e47-47bd-93a7-90224822f2bf (4489b301-2e47-47bd-93a7-90224822f2bf): created successfully Nov 04 19:08:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f08bacf-adb1-46da-bc5b-b670e4c6127c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:33 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Flow 'volume_create_manager' (e97fe9b1-1a4e-4d3f-a8df-65d082ebcdd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:33 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-bb48d0a7-de55-40f3-b81a-5fe190eb0a0b tempest-SnapshotDependencyTests-1946167227 None] Created volume successfully. Nov 04 19:08:33 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4cb34d2a-9ccd-42a5-b8de-f45d4828d708 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-8cb0ff0d-ac57-4897-89a0-531d09086c7d-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:33 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4cb34d2a-9ccd-42a5-b8de-f45d4828d708 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-8cb0ff0d-ac57-4897-89a0-531d09086c7d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:33 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4cb34d2a-9ccd-42a5-b8de-f45d4828d708 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-quobyte-f2b955c1-a50c-45c0-ae2a-d10d82f17832" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:33 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4cb34d2a-9ccd-42a5-b8de-f45d4828d708 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-f2b955c1-a50c-45c0-ae2a-d10d82f17832" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:33 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4cb34d2a-9ccd-42a5-b8de-f45d4828d708 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-quobyte-8cb0ff0d-ac57-4897-89a0-531d09086c7d" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:33 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4cb34d2a-9ccd-42a5-b8de-f45d4828d708 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-8cb0ff0d-ac57-4897-89a0-531d09086c7d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-4cb34d2a-9ccd-42a5-b8de-f45d4828d708 tempest-ProjectMemberTests-1705931170 None] Deleting offline snapshot 8cb0ff0d-ac57-4897-89a0-531d09086c7d of volume f2b955c1-a50c-45c0-ae2a-d10d82f17832 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:08:33 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-4cb34d2a-9ccd-42a5-b8de-f45d4828d708 tempest-ProjectMemberTests-1705931170 None] snapshot_file for this snap is: volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832.8cb0ff0d-ac57-4897-89a0-531d09086c7d {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:08:33 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3d7d5b-b165-4bac-992c-0afdc4b8f018]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:33 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4cb34d2a-9ccd-42a5-b8de-f45d4828d708 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832.8cb0ff0d-ac57-4897-89a0-531d09086c7d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:33 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832.8cb0ff0d-ac57-4897-89a0-531d09086c7d Nov 04 19:08:33 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:34 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4cb34d2a-9ccd-42a5-b8de-f45d4828d708 tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832.8cb0ff0d-ac57-4897-89a0-531d09086c7d" returned: 0 in 0.347s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-4cb34d2a-9ccd-42a5-b8de-f45d4828d708 tempest-ProjectMemberTests-1705931170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:08:34 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[67aa4be8-1209-4392-80e7-94e128a2c068]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4cb34d2a-9ccd-42a5-b8de-f45d4828d708 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:34 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832 Nov 04 19:08:34 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:34 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4cb34d2a-9ccd-42a5-b8de-f45d4828d708 tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832" returned: 0 in 0.362s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4cb34d2a-9ccd-42a5-b8de-f45d4828d708 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832.8cb0ff0d-ac57-4897-89a0-531d09086c7d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:34 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832.8cb0ff0d-ac57-4897-89a0-531d09086c7d Nov 04 19:08:34 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b9ee78c6-02df-47fe-99e2-b5852ded8719 tempest-SnapshotDependencyTests-1946167227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b9ee78c6-02df-47fe-99e2-b5852ded8719 tempest-SnapshotDependencyTests-1946167227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:34 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-b9ee78c6-02df-47fe-99e2-b5852ded8719 tempest-SnapshotDependencyTests-1946167227 None] Creating offline snapshot 932e3eb2-1233-4563-8a04-7a56e81390ec of volume 4489b301-2e47-47bd-93a7-90224822f2bf {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:08:34 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6f1a26-682e-4617-a34b-ed109929e464]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b9ee78c6-02df-47fe-99e2-b5852ded8719 tempest-SnapshotDependencyTests-1946167227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:34 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4cb34d2a-9ccd-42a5-b8de-f45d4828d708 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832.8cb0ff0d-ac57-4897-89a0-531d09086c7d" returned: 0 in 0.368s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:34 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4cb34d2a-9ccd-42a5-b8de-f45d4828d708 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832.8cb0ff0d-ac57-4897-89a0-531d09086c7d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:34 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832.8cb0ff0d-ac57-4897-89a0-531d09086c7d Nov 04 19:08:34 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:34 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf Nov 04 19:08:34 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:35 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4cb34d2a-9ccd-42a5-b8de-f45d4828d708 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832.8cb0ff0d-ac57-4897-89a0-531d09086c7d" returned: 0 in 0.243s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:35 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4cb34d2a-9ccd-42a5-b8de-f45d4828d708 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-8cb0ff0d-ac57-4897-89a0-531d09086c7d" released by "_delete_snapshot" :: held 1.416s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:35 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4cb34d2a-9ccd-42a5-b8de-f45d4828d708 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-f2b955c1-a50c-45c0-ae2a-d10d82f17832" released by "delete_snapshot" :: held 1.439s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:35 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b9ee78c6-02df-47fe-99e2-b5852ded8719 tempest-SnapshotDependencyTests-1946167227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf" returned: 0 in 0.358s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b9ee78c6-02df-47fe-99e2-b5852ded8719 tempest-SnapshotDependencyTests-1946167227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.932e3eb2-1233-4563-8a04-7a56e81390ec 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:35 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.932e3eb2-1233-4563-8a04-7a56e81390ec 1G Nov 04 19:08:35 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:35 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-4cb34d2a-9ccd-42a5-b8de-f45d4828d708 tempest-ProjectMemberTests-1705931170 None] Created reservations ['a6756d83-3ab4-4d73-8816-0174c426766e', 'c6a6d3bd-7e83-4453-b359-60125763fb62', '3eafdaf8-0b6b-451d-ba88-b45b40f92c9c', '9a11fde9-b73c-44cd-8a60-919c0b804888'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:35 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-4cb34d2a-9ccd-42a5-b8de-f45d4828d708 tempest-ProjectMemberTests-1705931170 None] Delete snapshot completed successfully. Nov 04 19:08:35 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4cb34d2a-9ccd-42a5-b8de-f45d4828d708 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-8cb0ff0d-ac57-4897-89a0-531d09086c7d-delete_snapshot" released by "delete_snapshot" :: held 1.590s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:35 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b9ee78c6-02df-47fe-99e2-b5852ded8719 tempest-SnapshotDependencyTests-1946167227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.932e3eb2-1233-4563-8a04-7a56e81390ec 1G" returned: 0 in 0.377s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b9ee78c6-02df-47fe-99e2-b5852ded8719 tempest-SnapshotDependencyTests-1946167227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4489b301-2e47-47bd-93a7-90224822f2bf -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.932e3eb2-1233-4563-8a04-7a56e81390ec {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:35 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4489b301-2e47-47bd-93a7-90224822f2bf -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.932e3eb2-1233-4563-8a04-7a56e81390ec Nov 04 19:08:35 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:35 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-070b04e1-95d9-425b-bd62-60e47e4a8baa tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-f2b955c1-a50c-45c0-ae2a-d10d82f17832-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:35 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-070b04e1-95d9-425b-bd62-60e47e4a8baa tempest-ProjectMemberTests-1705931170 None] Lock "cinder-f2b955c1-a50c-45c0-ae2a-d10d82f17832-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:35 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b9ee78c6-02df-47fe-99e2-b5852ded8719 tempest-SnapshotDependencyTests-1946167227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4489b301-2e47-47bd-93a7-90224822f2bf -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.932e3eb2-1233-4563-8a04-7a56e81390ec" returned: 0 in 0.319s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:35 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-b9ee78c6-02df-47fe-99e2-b5852ded8719 tempest-SnapshotDependencyTests-1946167227 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.932e3eb2-1233-4563-8a04-7a56e81390ec is being set with open permissions: ugo+rw Nov 04 19:08:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b9ee78c6-02df-47fe-99e2-b5852ded8719 tempest-SnapshotDependencyTests-1946167227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.932e3eb2-1233-4563-8a04-7a56e81390ec {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:35 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-070b04e1-95d9-425b-bd62-60e47e4a8baa tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-quobyte-f2b955c1-a50c-45c0-ae2a-d10d82f17832" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:35 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.932e3eb2-1233-4563-8a04-7a56e81390ec Nov 04 19:08:35 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:35 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-070b04e1-95d9-425b-bd62-60e47e4a8baa tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-f2b955c1-a50c-45c0-ae2a-d10d82f17832" acquired by "delete_volume" :: waited 0.016s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:35 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e0906d-8ea0-4ad9-b75d-dabfe3dc46e3]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:35 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-070b04e1-95d9-425b-bd62-60e47e4a8baa tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:36 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832 Nov 04 19:08:36 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:36 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b9ee78c6-02df-47fe-99e2-b5852ded8719 tempest-SnapshotDependencyTests-1946167227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.932e3eb2-1233-4563-8a04-7a56e81390ec" returned: 0 in 0.246s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b9ee78c6-02df-47fe-99e2-b5852ded8719 tempest-SnapshotDependencyTests-1946167227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:36 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.info Nov 04 19:08:36 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:36 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-070b04e1-95d9-425b-bd62-60e47e4a8baa tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832" returned: 0 in 0.382s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-070b04e1-95d9-425b-bd62-60e47e4a8baa tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:36 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832 Nov 04 19:08:36 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:36 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b9ee78c6-02df-47fe-99e2-b5852ded8719 tempest-SnapshotDependencyTests-1946167227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.info" returned: 0 in 0.263s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:36 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-b9ee78c6-02df-47fe-99e2-b5852ded8719 tempest-SnapshotDependencyTests-1946167227 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.info is being set with open permissions: ugo+rw Nov 04 19:08:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b9ee78c6-02df-47fe-99e2-b5852ded8719 tempest-SnapshotDependencyTests-1946167227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:36 devstack sudo[108002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.info Nov 04 19:08:36 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:36 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-070b04e1-95d9-425b-bd62-60e47e4a8baa tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-f2b955c1-a50c-45c0-ae2a-d10d82f17832" returned: 0 in 0.261s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:36 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-070b04e1-95d9-425b-bd62-60e47e4a8baa tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-f2b955c1-a50c-45c0-ae2a-d10d82f17832" released by "delete_volume" :: held 0.703s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:36 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-070b04e1-95d9-425b-bd62-60e47e4a8baa tempest-ProjectMemberTests-1705931170 None] Created reservations ['efee4d56-76f7-432d-bd39-cbb6ffe4fefc', '9a187aa8-dffb-4da8-a045-cbc3ab88deef', 'e80a4b61-3dad-43e7-85de-544bc48f31a9', '49f9891d-f852-46e4-92a0-3515146635fa'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:36 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-b9ee78c6-02df-47fe-99e2-b5852ded8719 tempest-SnapshotDependencyTests-1946167227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.info" returned: 0 in 0.257s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-b9ee78c6-02df-47fe-99e2-b5852ded8719 tempest-SnapshotDependencyTests-1946167227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.916s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:36 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-b9ee78c6-02df-47fe-99e2-b5852ded8719 tempest-SnapshotDependencyTests-1946167227 None] Create snapshot completed successfully Nov 04 19:08:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-070b04e1-95d9-425b-bd62-60e47e4a8baa tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-070b04e1-95d9-425b-bd62-60e47e4a8baa tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:36 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-070b04e1-95d9-425b-bd62-60e47e4a8baa tempest-ProjectMemberTests-1705931170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:36 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-070b04e1-95d9-425b-bd62-60e47e4a8baa tempest-ProjectMemberTests-1705931170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-070b04e1-95d9-425b-bd62-60e47e4a8baa tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:36 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-070b04e1-95d9-425b-bd62-60e47e4a8baa tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:36 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:08:36 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:37 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-070b04e1-95d9-425b-bd62-60e47e4a8baa tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.248s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-070b04e1-95d9-425b-bd62-60e47e4a8baa tempest-ProjectMemberTests-1705931170 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:37 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-070b04e1-95d9-425b-bd62-60e47e4a8baa tempest-ProjectMemberTests-1705931170 None] Deleted volume successfully. Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-070b04e1-95d9-425b-bd62-60e47e4a8baa tempest-ProjectMemberTests-1705931170 None] Lock "cinder-f2b955c1-a50c-45c0-ae2a-d10d82f17832-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Flow 'volume_create_manager' (744523f7-7ac3-4967-ac59-842eb2dc8b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a4e38ad-63ea-42f3-a315-5f86f6082df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a4e38ad-63ea-42f3-a315-5f86f6082df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-366438955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05384548-363a-434d-bc00-45d350ac229e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eea4506f7224002863cfaf3510e93b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:37Z,use_quota=True,user_id='cd1b5ab70cb74972a3562eb0a2e88be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a89549f7-931a-4032-8849-cf93b24bcc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a89549f7-931a-4032-8849-cf93b24bcc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b54d55e-de9e-4795-a84e-441e2a0d10f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b54d55e-de9e-4795-a84e-441e2a0d10f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05384548-363a-434d-bc00-45d350ac229e', 'volume_name': 'volume-05384548-363a-434d-bc00-45d350ac229e', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a3f5231-cb0f-4568-99ad-4086fb00ae95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a3f5231-cb0f-4568-99ad-4086fb00ae95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a02809b-9078-49ad-828b-c2d3c57b195b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:37 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Volume 05384548-363a-434d-bc00-45d350ac229e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05384548-363a-434d-bc00-45d350ac229e', 'volume_size': 1} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-366438955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05384548-363a-434d-bc00-45d350ac229e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eea4506f7224002863cfaf3510e93b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:37Z,use_quota=True,user_id='cd1b5ab70cb74972a3562eb0a2e88be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Creating volume 05384548-363a-434d-bc00-45d350ac229e {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:08:37 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:37 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e 1073741824 Nov 04 19:08:37 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Flow 'volume_create_manager' (59a05d1c-bac9-471c-9858-540ef021fd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee5dd62-1b5c-4dd8-8f6f-58857b443e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee5dd62-1b5c-4dd8-8f6f-58857b443e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f17c63-1ba4-42f7-8483-f7ce797ce88a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f97a8acc4cb459d8ba221e3cbcf3100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=932e3eb2-1233-4563-8a04-7a56e81390ec,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:38Z,use_quota=True,user_id='f44481f57ed141c7aa8dab5f3c29e6c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc514aa-8c1c-4506-a756-635468bdd804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc514aa-8c1c-4506-a756-635468bdd804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e17a21fb-1ac2-4355-abdb-13e77bf8c6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e17a21fb-1ac2-4355-abdb-13e77bf8c6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '30f17c63-1ba4-42f7-8483-f7ce797ce88a', 'volume_name': 'volume-30f17c63-1ba4-42f7-8483-f7ce797ce88a', 'volume_size': 1, 'snapshot_id': '932e3eb2-1233-4563-8a04-7a56e81390ec'}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de68b061-6c67-4f5c-8fd4-b2fd2bc4fd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de68b061-6c67-4f5c-8fd4-b2fd2bc4fd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9fa3db1-589b-432f-be03-3a92c6200838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:37 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Volume 30f17c63-1ba4-42f7-8483-f7ce797ce88a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-30f17c63-1ba4-42f7-8483-f7ce797ce88a', 'volume_size': 1, 'snapshot_id': '932e3eb2-1233-4563-8a04-7a56e81390ec'} Nov 04 19:08:37 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:38 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e 1073741824" returned: 0 in 0.407s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:38 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e Nov 04 19:08:38 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:38 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e" returned: 0 in 0.276s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.579s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Acquiring lock "cinder-quobyte-932e3eb2-1233-4563-8a04-7a56e81390ec-30f17c63-1ba4-42f7-8483-f7ce797ce88a" by "_create_volume_from_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a02809b-9078-49ad-828b-c2d3c57b195b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05384548-363a-434d-bc00-45d350ac229e', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2015603a-23c8-47ca-a5dc-acb4662f5e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Lock "cinder-quobyte-932e3eb2-1233-4563-8a04-7a56e81390ec-30f17c63-1ba4-42f7-8483-f7ce797ce88a" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Creating volume 30f17c63-1ba4-42f7-8483-f7ce797ce88a from snapshot 932e3eb2-1233-4563-8a04-7a56e81390ec {{(pid=87119) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Acquiring lock "cinder-quobyte-30f17c63-1ba4-42f7-8483-f7ce797ce88a" by "_copy_volume_from_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:38 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Volume volume-05384548-363a-434d-bc00-45d350ac229e (05384548-363a-434d-bc00-45d350ac229e): created successfully Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2015603a-23c8-47ca-a5dc-acb4662f5e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Flow 'volume_create_manager' (744523f7-7ac3-4967-ac59-842eb2dc8b9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Lock "cinder-quobyte-30f17c63-1ba4-42f7-8483-f7ce797ce88a" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] snapshot: 932e3eb2-1233-4563-8a04-7a56e81390ec, volume: 30f17c63-1ba4-42f7-8483-f7ce797ce88a, {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:38 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-cfaaa4ee-1c30-4414-9690-4f0f3c02cd64 tempest-ProjectMemberTests-1705931170 None] Created volume successfully. Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b98b5a-bf5e-4027-8a5b-0b5979885b06]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.932e3eb2-1233-4563-8a04-7a56e81390ec {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:38 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.932e3eb2-1233-4563-8a04-7a56e81390ec Nov 04 19:08:38 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:38 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.932e3eb2-1233-4563-8a04-7a56e81390ec" returned: 0 in 0.339s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4489b301-2e47-47bd-93a7-90224822f2bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f84f50c-9237-4e32-bd43-c7a59f514e2f]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:38 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:39 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf Nov 04 19:08:39 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:39 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf" returned: 0 in 0.347s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:39 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:08:39 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Creating direct copy from snapshot {{(pid=87119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:08:39 devstack cinder-volume[87119]: DEBUG cinder.utils [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Path /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-30f17c63-1ba4-42f7-8483-f7ce797ce88a not found in is_blk_device check {{(pid=87119) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:08:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-30f17c63-1ba4-42f7-8483-f7ce797ce88a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:39 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-30f17c63-1ba4-42f7-8483-f7ce797ce88a Nov 04 19:08:39 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:39 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f215e173-50ec-4350-9531-9a1cd69303b3 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:45 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-30f17c63-1ba4-42f7-8483-f7ce797ce88a" returned: 0 in 5.799s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:45 devstack cinder-volume[87119]: DEBUG cinder.image.image_utils [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Image conversion details: src /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-30f17c63-1ba4-42f7-8483-f7ce797ce88a {{(pid=87119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:08:45 devstack cinder-volume[87119]: INFO cinder.image.image_utils [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Converted 1024.00 MB image at 176.56 MB/s Nov 04 19:08:45 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-30f17c63-1ba4-42f7-8483-f7ce797ce88a is being set with open permissions: ugo+rw Nov 04 19:08:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-30f17c63-1ba4-42f7-8483-f7ce797ce88a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:45 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-30f17c63-1ba4-42f7-8483-f7ce797ce88a Nov 04 19:08:45 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:45 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-30f17c63-1ba4-42f7-8483-f7ce797ce88a" returned: 0 in 0.238s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Lock "cinder-quobyte-30f17c63-1ba4-42f7-8483-f7ce797ce88a" released by "_copy_volume_from_snapshot" :: held 6.809s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:45 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Lock "cinder-quobyte-932e3eb2-1233-4563-8a04-7a56e81390ec-30f17c63-1ba4-42f7-8483-f7ce797ce88a" released by "_create_volume_from_snapshot" :: held 6.894s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.930s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f215e173-50ec-4350-9531-9a1cd69303b3 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.613s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:45 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-f215e173-50ec-4350-9531-9a1cd69303b3 tempest-ProjectMemberTests-1705931170 None] Creating offline snapshot ba318a06-dcf1-4fef-8192-d7c67a7a4db3 of volume 05384548-363a-434d-bc00-45d350ac229e {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:08:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9fa3db1-589b-432f-be03-3a92c6200838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30f17c63-1ba4-42f7-8483-f7ce797ce88a', 'volume_size': 1, 'snapshot_id': '932e3eb2-1233-4563-8a04-7a56e81390ec'}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6296d8-6839-4502-bada-798c9a2ddeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:45 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ebd769-db17-4aec-86a6-22a0fa932a50]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f215e173-50ec-4350-9531-9a1cd69303b3 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:45 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Volume volume-30f17c63-1ba4-42f7-8483-f7ce797ce88a (30f17c63-1ba4-42f7-8483-f7ce797ce88a): created successfully Nov 04 19:08:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6296d8-6839-4502-bada-798c9a2ddeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:45 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Flow 'volume_create_manager' (59a05d1c-bac9-471c-9858-540ef021fd2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:45 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-69515691-8147-4705-92f7-c52a7c9a9e82 tempest-SnapshotDependencyTests-1946167227 None] Created volume successfully. Nov 04 19:08:45 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e Nov 04 19:08:45 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:45 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f215e173-50ec-4350-9531-9a1cd69303b3 tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e" returned: 0 in 0.352s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:45 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f215e173-50ec-4350-9531-9a1cd69303b3 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e.ba318a06-dcf1-4fef-8192-d7c67a7a4db3 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:45 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e.ba318a06-dcf1-4fef-8192-d7c67a7a4db3 1G Nov 04 19:08:45 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:46 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f215e173-50ec-4350-9531-9a1cd69303b3 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e.ba318a06-dcf1-4fef-8192-d7c67a7a4db3 1G" returned: 0 in 0.449s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f215e173-50ec-4350-9531-9a1cd69303b3 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05384548-363a-434d-bc00-45d350ac229e -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e.ba318a06-dcf1-4fef-8192-d7c67a7a4db3 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f5b5c1ad-d226-4208-a168-525817263213 tempest-SnapshotDependencyTests-1946167227 None] Acquiring lock "cinder-932e3eb2-1233-4563-8a04-7a56e81390ec-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:46 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05384548-363a-434d-bc00-45d350ac229e -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e.ba318a06-dcf1-4fef-8192-d7c67a7a4db3 Nov 04 19:08:46 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f5b5c1ad-d226-4208-a168-525817263213 tempest-SnapshotDependencyTests-1946167227 None] Lock "cinder-932e3eb2-1233-4563-8a04-7a56e81390ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f5b5c1ad-d226-4208-a168-525817263213 tempest-SnapshotDependencyTests-1946167227 None] Acquiring lock "cinder-quobyte-4489b301-2e47-47bd-93a7-90224822f2bf" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f5b5c1ad-d226-4208-a168-525817263213 tempest-SnapshotDependencyTests-1946167227 None] Lock "cinder-quobyte-4489b301-2e47-47bd-93a7-90224822f2bf" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f5b5c1ad-d226-4208-a168-525817263213 tempest-SnapshotDependencyTests-1946167227 None] Acquiring lock "cinder-quobyte-932e3eb2-1233-4563-8a04-7a56e81390ec" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:46 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f5b5c1ad-d226-4208-a168-525817263213 tempest-SnapshotDependencyTests-1946167227 None] Lock "cinder-quobyte-932e3eb2-1233-4563-8a04-7a56e81390ec" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-f5b5c1ad-d226-4208-a168-525817263213 tempest-SnapshotDependencyTests-1946167227 None] Deleting offline snapshot 932e3eb2-1233-4563-8a04-7a56e81390ec of volume 4489b301-2e47-47bd-93a7-90224822f2bf {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:08:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-f5b5c1ad-d226-4208-a168-525817263213 tempest-SnapshotDependencyTests-1946167227 None] snapshot_file for this snap is: volume-4489b301-2e47-47bd-93a7-90224822f2bf.932e3eb2-1233-4563-8a04-7a56e81390ec {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:08:46 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d1900e-c437-466a-a19a-987ec2dd7a46]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f5b5c1ad-d226-4208-a168-525817263213 tempest-SnapshotDependencyTests-1946167227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.932e3eb2-1233-4563-8a04-7a56e81390ec {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:46 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.932e3eb2-1233-4563-8a04-7a56e81390ec Nov 04 19:08:46 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:46 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f215e173-50ec-4350-9531-9a1cd69303b3 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05384548-363a-434d-bc00-45d350ac229e -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e.ba318a06-dcf1-4fef-8192-d7c67a7a4db3" returned: 0 in 0.310s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:46 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-f215e173-50ec-4350-9531-9a1cd69303b3 tempest-ProjectMemberTests-1705931170 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e.ba318a06-dcf1-4fef-8192-d7c67a7a4db3 is being set with open permissions: ugo+rw Nov 04 19:08:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f215e173-50ec-4350-9531-9a1cd69303b3 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e.ba318a06-dcf1-4fef-8192-d7c67a7a4db3 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:46 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e.ba318a06-dcf1-4fef-8192-d7c67a7a4db3 Nov 04 19:08:46 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:46 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f5b5c1ad-d226-4208-a168-525817263213 tempest-SnapshotDependencyTests-1946167227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.932e3eb2-1233-4563-8a04-7a56e81390ec" returned: 0 in 0.399s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:46 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-f5b5c1ad-d226-4208-a168-525817263213 tempest-SnapshotDependencyTests-1946167227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4489b301-2e47-47bd-93a7-90224822f2bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:08:46 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[633df3ac-94a3-4292-a6c0-f0ba28ca2545]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f5b5c1ad-d226-4208-a168-525817263213 tempest-SnapshotDependencyTests-1946167227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:46 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f215e173-50ec-4350-9531-9a1cd69303b3 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e.ba318a06-dcf1-4fef-8192-d7c67a7a4db3" returned: 0 in 0.248s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:46 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f215e173-50ec-4350-9531-9a1cd69303b3 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:46 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e.info Nov 04 19:08:46 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:46 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf Nov 04 19:08:46 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:47 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f215e173-50ec-4350-9531-9a1cd69303b3 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e.info" returned: 0 in 0.299s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:47 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-f215e173-50ec-4350-9531-9a1cd69303b3 tempest-ProjectMemberTests-1705931170 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e.info is being set with open permissions: ugo+rw Nov 04 19:08:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f215e173-50ec-4350-9531-9a1cd69303b3 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:47 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e.info Nov 04 19:08:47 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:47 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:47 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f5b5c1ad-d226-4208-a168-525817263213 tempest-SnapshotDependencyTests-1946167227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf" returned: 0 in 0.583s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f5b5c1ad-d226-4208-a168-525817263213 tempest-SnapshotDependencyTests-1946167227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.932e3eb2-1233-4563-8a04-7a56e81390ec {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f215e173-50ec-4350-9531-9a1cd69303b3 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e.info" returned: 0 in 0.254s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:47 devstack sudo[108080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.932e3eb2-1233-4563-8a04-7a56e81390ec Nov 04 19:08:47 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f215e173-50ec-4350-9531-9a1cd69303b3 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.018s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:47 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-f215e173-50ec-4350-9531-9a1cd69303b3 tempest-ProjectMemberTests-1705931170 None] Create snapshot completed successfully Nov 04 19:08:47 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f5b5c1ad-d226-4208-a168-525817263213 tempest-SnapshotDependencyTests-1946167227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.932e3eb2-1233-4563-8a04-7a56e81390ec" returned: 0 in 0.329s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f5b5c1ad-d226-4208-a168-525817263213 tempest-SnapshotDependencyTests-1946167227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.932e3eb2-1233-4563-8a04-7a56e81390ec {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:47 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.932e3eb2-1233-4563-8a04-7a56e81390ec Nov 04 19:08:47 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:47 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:47 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f5b5c1ad-d226-4208-a168-525817263213 tempest-SnapshotDependencyTests-1946167227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf.932e3eb2-1233-4563-8a04-7a56e81390ec" returned: 0 in 0.264s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:47 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f5b5c1ad-d226-4208-a168-525817263213 tempest-SnapshotDependencyTests-1946167227 None] Lock "cinder-quobyte-932e3eb2-1233-4563-8a04-7a56e81390ec" released by "_delete_snapshot" :: held 1.685s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f5b5c1ad-d226-4208-a168-525817263213 tempest-SnapshotDependencyTests-1946167227 None] Lock "cinder-quobyte-4489b301-2e47-47bd-93a7-90224822f2bf" released by "delete_snapshot" :: held 1.706s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:48 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-f5b5c1ad-d226-4208-a168-525817263213 tempest-SnapshotDependencyTests-1946167227 None] Created reservations ['b73a3bbf-2106-47eb-86a7-1a1d6197caad', 'bec48556-4cff-4306-b4d6-e7cb2f3205e7', '40a67af5-88f4-487f-88b1-d1f0fe2b886c', 'c874ef23-476a-4446-8df4-ad387515959b'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:48 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-f5b5c1ad-d226-4208-a168-525817263213 tempest-SnapshotDependencyTests-1946167227 None] Delete snapshot completed successfully. Nov 04 19:08:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f5b5c1ad-d226-4208-a168-525817263213 tempest-SnapshotDependencyTests-1946167227 None] Lock "cinder-932e3eb2-1233-4563-8a04-7a56e81390ec-delete_snapshot" released by "delete_snapshot" :: held 1.859s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a85a8599-609d-437c-9f3e-723f1211156a tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-ba318a06-dcf1-4fef-8192-d7c67a7a4db3-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a85a8599-609d-437c-9f3e-723f1211156a tempest-ProjectMemberTests-1705931170 None] Lock "cinder-ba318a06-dcf1-4fef-8192-d7c67a7a4db3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a85a8599-609d-437c-9f3e-723f1211156a tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-quobyte-05384548-363a-434d-bc00-45d350ac229e" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a85a8599-609d-437c-9f3e-723f1211156a tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-05384548-363a-434d-bc00-45d350ac229e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a85a8599-609d-437c-9f3e-723f1211156a tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-quobyte-ba318a06-dcf1-4fef-8192-d7c67a7a4db3" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a85a8599-609d-437c-9f3e-723f1211156a tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-ba318a06-dcf1-4fef-8192-d7c67a7a4db3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-a85a8599-609d-437c-9f3e-723f1211156a tempest-ProjectMemberTests-1705931170 None] Deleting offline snapshot ba318a06-dcf1-4fef-8192-d7c67a7a4db3 of volume 05384548-363a-434d-bc00-45d350ac229e {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:08:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-a85a8599-609d-437c-9f3e-723f1211156a tempest-ProjectMemberTests-1705931170 None] snapshot_file for this snap is: volume-05384548-363a-434d-bc00-45d350ac229e.ba318a06-dcf1-4fef-8192-d7c67a7a4db3 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:08:48 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[8baf43c3-8ee5-46d7-ab18-9961ebe47e1f]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a85a8599-609d-437c-9f3e-723f1211156a tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e.ba318a06-dcf1-4fef-8192-d7c67a7a4db3 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e64b9ec2-5a80-4cfa-b618-5d44dee69419 tempest-SnapshotDependencyTests-1946167227 None] Acquiring lock "cinder-4489b301-2e47-47bd-93a7-90224822f2bf-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e64b9ec2-5a80-4cfa-b618-5d44dee69419 tempest-SnapshotDependencyTests-1946167227 None] Lock "cinder-4489b301-2e47-47bd-93a7-90224822f2bf-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:48 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e.ba318a06-dcf1-4fef-8192-d7c67a7a4db3 Nov 04 19:08:48 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e64b9ec2-5a80-4cfa-b618-5d44dee69419 tempest-SnapshotDependencyTests-1946167227 None] Acquiring lock "cinder-quobyte-4489b301-2e47-47bd-93a7-90224822f2bf" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:48 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e64b9ec2-5a80-4cfa-b618-5d44dee69419 tempest-SnapshotDependencyTests-1946167227 None] Lock "cinder-quobyte-4489b301-2e47-47bd-93a7-90224822f2bf" acquired by "delete_volume" :: waited 0.016s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:48 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc02884e-9f4a-4ece-80f0-e844c05fcf2b]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e64b9ec2-5a80-4cfa-b618-5d44dee69419 tempest-SnapshotDependencyTests-1946167227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:48 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf Nov 04 19:08:48 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:48 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a85a8599-609d-437c-9f3e-723f1211156a tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e.ba318a06-dcf1-4fef-8192-d7c67a7a4db3" returned: 0 in 0.442s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:48 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-a85a8599-609d-437c-9f3e-723f1211156a tempest-ProjectMemberTests-1705931170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05384548-363a-434d-bc00-45d350ac229e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:08:48 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2167fb-6864-4589-b90c-1d40c0155b7e]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a85a8599-609d-437c-9f3e-723f1211156a tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:48 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e Nov 04 19:08:48 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:48 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e64b9ec2-5a80-4cfa-b618-5d44dee69419 tempest-SnapshotDependencyTests-1946167227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf" returned: 0 in 0.422s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:48 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e64b9ec2-5a80-4cfa-b618-5d44dee69419 tempest-SnapshotDependencyTests-1946167227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:49 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf Nov 04 19:08:49 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:49 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a85a8599-609d-437c-9f3e-723f1211156a tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e" returned: 0 in 0.418s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a85a8599-609d-437c-9f3e-723f1211156a tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e.ba318a06-dcf1-4fef-8192-d7c67a7a4db3 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:49 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e.ba318a06-dcf1-4fef-8192-d7c67a7a4db3 Nov 04 19:08:49 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:49 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e64b9ec2-5a80-4cfa-b618-5d44dee69419 tempest-SnapshotDependencyTests-1946167227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-4489b301-2e47-47bd-93a7-90224822f2bf" returned: 0 in 0.275s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:49 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e64b9ec2-5a80-4cfa-b618-5d44dee69419 tempest-SnapshotDependencyTests-1946167227 None] Lock "cinder-quobyte-4489b301-2e47-47bd-93a7-90224822f2bf" released by "delete_volume" :: held 0.782s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:49 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-e64b9ec2-5a80-4cfa-b618-5d44dee69419 tempest-SnapshotDependencyTests-1946167227 None] Created reservations ['42c4c873-f58f-4670-b30a-bac70a2579b2', '93fb7938-fe09-4ec6-909d-52c42d43b4da', 'a3fc81e1-78e8-4e48-b2ed-f7457a4b1147', '606dec79-ec15-4551-bd6a-8ac8567d79c0'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e64b9ec2-5a80-4cfa-b618-5d44dee69419 tempest-SnapshotDependencyTests-1946167227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e64b9ec2-5a80-4cfa-b618-5d44dee69419 tempest-SnapshotDependencyTests-1946167227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:49 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e64b9ec2-5a80-4cfa-b618-5d44dee69419 tempest-SnapshotDependencyTests-1946167227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:49 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e64b9ec2-5a80-4cfa-b618-5d44dee69419 tempest-SnapshotDependencyTests-1946167227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e64b9ec2-5a80-4cfa-b618-5d44dee69419 tempest-SnapshotDependencyTests-1946167227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e64b9ec2-5a80-4cfa-b618-5d44dee69419 tempest-SnapshotDependencyTests-1946167227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:49 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:08:49 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:49 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a85a8599-609d-437c-9f3e-723f1211156a tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e.ba318a06-dcf1-4fef-8192-d7c67a7a4db3" returned: 0 in 0.385s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a85a8599-609d-437c-9f3e-723f1211156a tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e.ba318a06-dcf1-4fef-8192-d7c67a7a4db3 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:49 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9f239e9b-6c17-4646-a2df-cda37ce026f0 tempest-SnapshotDependencyTests-1946167227 None] Acquiring lock "cinder-30f17c63-1ba4-42f7-8483-f7ce797ce88a-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:49 devstack sudo[108114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e.ba318a06-dcf1-4fef-8192-d7c67a7a4db3 Nov 04 19:08:49 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:49 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9f239e9b-6c17-4646-a2df-cda37ce026f0 tempest-SnapshotDependencyTests-1946167227 None] Lock "cinder-30f17c63-1ba4-42f7-8483-f7ce797ce88a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:49 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9f239e9b-6c17-4646-a2df-cda37ce026f0 tempest-SnapshotDependencyTests-1946167227 None] Acquiring lock "cinder-quobyte-30f17c63-1ba4-42f7-8483-f7ce797ce88a" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:49 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9f239e9b-6c17-4646-a2df-cda37ce026f0 tempest-SnapshotDependencyTests-1946167227 None] Lock "cinder-quobyte-30f17c63-1ba4-42f7-8483-f7ce797ce88a" acquired by "delete_volume" :: waited 0.017s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:49 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e64b9ec2-5a80-4cfa-b618-5d44dee69419 tempest-SnapshotDependencyTests-1946167227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.316s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:49 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-e64b9ec2-5a80-4cfa-b618-5d44dee69419 tempest-SnapshotDependencyTests-1946167227 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:49 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e64b9ec2-5a80-4cfa-b618-5d44dee69419 tempest-SnapshotDependencyTests-1946167227 None] Deleted volume successfully. Nov 04 19:08:49 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd53731d-df9e-499b-a55d-c9f22c3bec3d]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9f239e9b-6c17-4646-a2df-cda37ce026f0 tempest-SnapshotDependencyTests-1946167227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-30f17c63-1ba4-42f7-8483-f7ce797ce88a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:49 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-e64b9ec2-5a80-4cfa-b618-5d44dee69419 tempest-SnapshotDependencyTests-1946167227 None] Lock "cinder-4489b301-2e47-47bd-93a7-90224822f2bf-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:49 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-30f17c63-1ba4-42f7-8483-f7ce797ce88a Nov 04 19:08:49 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:49 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:49 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-a85a8599-609d-437c-9f3e-723f1211156a tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e.ba318a06-dcf1-4fef-8192-d7c67a7a4db3" returned: 0 in 0.326s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:49 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a85a8599-609d-437c-9f3e-723f1211156a tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-ba318a06-dcf1-4fef-8192-d7c67a7a4db3" released by "_delete_snapshot" :: held 1.689s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:49 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a85a8599-609d-437c-9f3e-723f1211156a tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-05384548-363a-434d-bc00-45d350ac229e" released by "delete_snapshot" :: held 1.715s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:50 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-a85a8599-609d-437c-9f3e-723f1211156a tempest-ProjectMemberTests-1705931170 None] Created reservations ['c157c5d7-e4d1-4ab1-a827-2c3fa19654cb', 'df9e4347-5597-4a1a-9ef2-8cb02c725430', '943374e1-c29d-4f7e-8c65-95368e9e4850', '0815ae44-a156-4c23-a131-04a6d8471061'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:50 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-a85a8599-609d-437c-9f3e-723f1211156a tempest-ProjectMemberTests-1705931170 None] Delete snapshot completed successfully. Nov 04 19:08:50 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-a85a8599-609d-437c-9f3e-723f1211156a tempest-ProjectMemberTests-1705931170 None] Lock "cinder-ba318a06-dcf1-4fef-8192-d7c67a7a4db3-delete_snapshot" released by "delete_snapshot" :: held 1.868s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:50 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9f239e9b-6c17-4646-a2df-cda37ce026f0 tempest-SnapshotDependencyTests-1946167227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-30f17c63-1ba4-42f7-8483-f7ce797ce88a" returned: 0 in 0.395s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9f239e9b-6c17-4646-a2df-cda37ce026f0 tempest-SnapshotDependencyTests-1946167227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-30f17c63-1ba4-42f7-8483-f7ce797ce88a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:50 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-30f17c63-1ba4-42f7-8483-f7ce797ce88a Nov 04 19:08:50 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:50 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7ece1ca2-cbf9-4430-92ba-1d6204a17184 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-05384548-363a-434d-bc00-45d350ac229e-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:50 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7ece1ca2-cbf9-4430-92ba-1d6204a17184 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-05384548-363a-434d-bc00-45d350ac229e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:50 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9f239e9b-6c17-4646-a2df-cda37ce026f0 tempest-SnapshotDependencyTests-1946167227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-30f17c63-1ba4-42f7-8483-f7ce797ce88a" returned: 0 in 0.270s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:50 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9f239e9b-6c17-4646-a2df-cda37ce026f0 tempest-SnapshotDependencyTests-1946167227 None] Lock "cinder-quobyte-30f17c63-1ba4-42f7-8483-f7ce797ce88a" released by "delete_volume" :: held 0.724s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:50 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7ece1ca2-cbf9-4430-92ba-1d6204a17184 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-quobyte-05384548-363a-434d-bc00-45d350ac229e" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:50 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7ece1ca2-cbf9-4430-92ba-1d6204a17184 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-05384548-363a-434d-bc00-45d350ac229e" acquired by "delete_volume" :: waited 0.016s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:50 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f81e541-5c33-43a6-8ae9-f0df2d9cb6f6]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7ece1ca2-cbf9-4430-92ba-1d6204a17184 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:50 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-9f239e9b-6c17-4646-a2df-cda37ce026f0 tempest-SnapshotDependencyTests-1946167227 None] Created reservations ['75e9813f-f815-4993-8146-60cbe878e0bf', 'de4f662b-1a02-4148-9254-22ea392ad014', '951b1159-44f8-4259-a77f-220ff266cf2c', 'd39d0ef3-640c-4c76-8154-6d088b8a1578'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9f239e9b-6c17-4646-a2df-cda37ce026f0 tempest-SnapshotDependencyTests-1946167227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9f239e9b-6c17-4646-a2df-cda37ce026f0 tempest-SnapshotDependencyTests-1946167227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:50 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9f239e9b-6c17-4646-a2df-cda37ce026f0 tempest-SnapshotDependencyTests-1946167227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:50 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-9f239e9b-6c17-4646-a2df-cda37ce026f0 tempest-SnapshotDependencyTests-1946167227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-9f239e9b-6c17-4646-a2df-cda37ce026f0 tempest-SnapshotDependencyTests-1946167227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9f239e9b-6c17-4646-a2df-cda37ce026f0 tempest-SnapshotDependencyTests-1946167227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:50 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:08:50 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:50 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e Nov 04 19:08:50 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:50 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9f239e9b-6c17-4646-a2df-cda37ce026f0 tempest-SnapshotDependencyTests-1946167227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.282s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:50 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-9f239e9b-6c17-4646-a2df-cda37ce026f0 tempest-SnapshotDependencyTests-1946167227 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:50 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-9f239e9b-6c17-4646-a2df-cda37ce026f0 tempest-SnapshotDependencyTests-1946167227 None] Deleted volume successfully. Nov 04 19:08:50 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:50 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9f239e9b-6c17-4646-a2df-cda37ce026f0 tempest-SnapshotDependencyTests-1946167227 None] Lock "cinder-30f17c63-1ba4-42f7-8483-f7ce797ce88a-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7ece1ca2-cbf9-4430-92ba-1d6204a17184 tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e" returned: 0 in 0.411s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:50 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7ece1ca2-cbf9-4430-92ba-1d6204a17184 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:50 devstack sudo[108134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e Nov 04 19:08:50 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:51 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7ece1ca2-cbf9-4430-92ba-1d6204a17184 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-05384548-363a-434d-bc00-45d350ac229e" returned: 0 in 0.247s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:51 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7ece1ca2-cbf9-4430-92ba-1d6204a17184 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-05384548-363a-434d-bc00-45d350ac229e" released by "delete_volume" :: held 0.725s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:51 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-7ece1ca2-cbf9-4430-92ba-1d6204a17184 tempest-ProjectMemberTests-1705931170 None] Created reservations ['96c74978-c2ac-45ff-8d16-61c624e9f19b', '458920d6-2014-4a67-96b0-3e29ceeb26ab', 'ca9d7506-923d-4a14-aba0-36e5276e2617', '7cc18b99-1458-43cf-809f-8ab3f586612f'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7ece1ca2-cbf9-4430-92ba-1d6204a17184 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7ece1ca2-cbf9-4430-92ba-1d6204a17184 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:51 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7ece1ca2-cbf9-4430-92ba-1d6204a17184 tempest-ProjectMemberTests-1705931170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:51 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-7ece1ca2-cbf9-4430-92ba-1d6204a17184 tempest-ProjectMemberTests-1705931170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-7ece1ca2-cbf9-4430-92ba-1d6204a17184 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7ece1ca2-cbf9-4430-92ba-1d6204a17184 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:51 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:08:51 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:51 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:51 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-7ece1ca2-cbf9-4430-92ba-1d6204a17184 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.326s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:51 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-7ece1ca2-cbf9-4430-92ba-1d6204a17184 tempest-ProjectMemberTests-1705931170 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:51 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-7ece1ca2-cbf9-4430-92ba-1d6204a17184 tempest-ProjectMemberTests-1705931170 None] Deleted volume successfully. Nov 04 19:08:51 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-7ece1ca2-cbf9-4430-92ba-1d6204a17184 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-05384548-363a-434d-bc00-45d350ac229e-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:52 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:08:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Flow 'volume_create_manager' (d2d7ab43-5fa4-4f34-a7b3-1b55c7240b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76fdf77f-b60b-4bb5-9a5f-ece842d09238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76fdf77f-b60b-4bb5-9a5f-ece842d09238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1619858274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ecd69f0-99dd-45da-a248-73cbd5248758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eea4506f7224002863cfaf3510e93b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:52Z,use_quota=True,user_id='cd1b5ab70cb74972a3562eb0a2e88be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d1a2849-c281-48d8-afcf-6d36c91a169b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d1a2849-c281-48d8-afcf-6d36c91a169b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49051d87-31ed-46ac-9873-e77ed0294dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49051d87-31ed-46ac-9873-e77ed0294dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ecd69f0-99dd-45da-a248-73cbd5248758', 'volume_name': 'volume-7ecd69f0-99dd-45da-a248-73cbd5248758', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e6fd5b5-6239-44dc-95f5-7fb0c995f79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e6fd5b5-6239-44dc-95f5-7fb0c995f79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:52 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5493f20b-5d70-4019-9682-e4334f8500f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:52 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Volume 7ecd69f0-99dd-45da-a248-73cbd5248758: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ecd69f0-99dd-45da-a248-73cbd5248758', 'volume_size': 1} Nov 04 19:08:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:52 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1619858274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ecd69f0-99dd-45da-a248-73cbd5248758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eea4506f7224002863cfaf3510e93b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:52Z,use_quota=True,user_id='cd1b5ab70cb74972a3562eb0a2e88be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:08:52 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Creating volume 7ecd69f0-99dd-45da-a248-73cbd5248758 {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:08:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:52 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:52 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:52 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:08:52 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:08:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:52 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758 1073741824 Nov 04 19:08:52 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:52 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758 1073741824" returned: 0 in 0.492s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:52 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:52 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758 Nov 04 19:08:52 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:53 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758" returned: 0 in 0.291s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:53 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:08:53 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5493f20b-5d70-4019-9682-e4334f8500f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ecd69f0-99dd-45da-a248-73cbd5248758', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b454a3-3f10-49bc-87c4-ebf29fd0aa33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:53 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Volume volume-7ecd69f0-99dd-45da-a248-73cbd5248758 (7ecd69f0-99dd-45da-a248-73cbd5248758): created successfully Nov 04 19:08:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b454a3-3f10-49bc-87c4-ebf29fd0aa33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:53 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Flow 'volume_create_manager' (d2d7ab43-5fa4-4f34-a7b3-1b55c7240b97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:53 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-8881fdf6-1d37-452b-8274-8e8e83e01a77 tempest-ProjectMemberTests-1705931170 None] Created volume successfully. Nov 04 19:08:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-be687a10-8481-4e2e-91a7-8d8a4af78e36 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-be687a10-8481-4e2e-91a7-8d8a4af78e36 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:54 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-be687a10-8481-4e2e-91a7-8d8a4af78e36 tempest-ProjectMemberTests-1705931170 None] Creating offline snapshot e001d003-3938-4129-91ac-665ba6b2292b of volume 7ecd69f0-99dd-45da-a248-73cbd5248758 {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:08:54 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[1495f3c4-3ead-4d5f-acca-1a438ca890d2]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-be687a10-8481-4e2e-91a7-8d8a4af78e36 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:54 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758 Nov 04 19:08:54 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:54 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-be687a10-8481-4e2e-91a7-8d8a4af78e36 tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758" returned: 0 in 0.475s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:54 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-be687a10-8481-4e2e-91a7-8d8a4af78e36 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758.e001d003-3938-4129-91ac-665ba6b2292b 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:54 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758.e001d003-3938-4129-91ac-665ba6b2292b 1G Nov 04 19:08:54 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:55 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-be687a10-8481-4e2e-91a7-8d8a4af78e36 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758.e001d003-3938-4129-91ac-665ba6b2292b 1G" returned: 0 in 0.461s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-be687a10-8481-4e2e-91a7-8d8a4af78e36 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ecd69f0-99dd-45da-a248-73cbd5248758 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758.e001d003-3938-4129-91ac-665ba6b2292b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:55 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ecd69f0-99dd-45da-a248-73cbd5248758 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758.e001d003-3938-4129-91ac-665ba6b2292b Nov 04 19:08:55 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:55 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-be687a10-8481-4e2e-91a7-8d8a4af78e36 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ecd69f0-99dd-45da-a248-73cbd5248758 -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758.e001d003-3938-4129-91ac-665ba6b2292b" returned: 0 in 0.355s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:55 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-be687a10-8481-4e2e-91a7-8d8a4af78e36 tempest-ProjectMemberTests-1705931170 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758.e001d003-3938-4129-91ac-665ba6b2292b is being set with open permissions: ugo+rw Nov 04 19:08:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-be687a10-8481-4e2e-91a7-8d8a4af78e36 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758.e001d003-3938-4129-91ac-665ba6b2292b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:55 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758.e001d003-3938-4129-91ac-665ba6b2292b Nov 04 19:08:55 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:55 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-be687a10-8481-4e2e-91a7-8d8a4af78e36 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758.e001d003-3938-4129-91ac-665ba6b2292b" returned: 0 in 0.262s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:55 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-be687a10-8481-4e2e-91a7-8d8a4af78e36 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:56 devstack sudo[108169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758.info Nov 04 19:08:56 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:56 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-be687a10-8481-4e2e-91a7-8d8a4af78e36 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758.info" returned: 0 in 0.264s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:56 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-be687a10-8481-4e2e-91a7-8d8a4af78e36 tempest-ProjectMemberTests-1705931170 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758.info is being set with open permissions: ugo+rw Nov 04 19:08:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-be687a10-8481-4e2e-91a7-8d8a4af78e36 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:56 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758.info Nov 04 19:08:56 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:56 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-be687a10-8481-4e2e-91a7-8d8a4af78e36 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758.info" returned: 0 in 0.322s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:56 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-be687a10-8481-4e2e-91a7-8d8a4af78e36 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.238s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:56 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-be687a10-8481-4e2e-91a7-8d8a4af78e36 tempest-ProjectMemberTests-1705931170 None] Create snapshot completed successfully Nov 04 19:08:57 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4731ac3c-68f5-43c8-a0ff-3f6c4ba53653 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-e001d003-3938-4129-91ac-665ba6b2292b-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:57 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4731ac3c-68f5-43c8-a0ff-3f6c4ba53653 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-e001d003-3938-4129-91ac-665ba6b2292b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:57 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4731ac3c-68f5-43c8-a0ff-3f6c4ba53653 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-quobyte-7ecd69f0-99dd-45da-a248-73cbd5248758" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:57 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4731ac3c-68f5-43c8-a0ff-3f6c4ba53653 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-7ecd69f0-99dd-45da-a248-73cbd5248758" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:57 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4731ac3c-68f5-43c8-a0ff-3f6c4ba53653 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-quobyte-e001d003-3938-4129-91ac-665ba6b2292b" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:57 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4731ac3c-68f5-43c8-a0ff-3f6c4ba53653 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-e001d003-3938-4129-91ac-665ba6b2292b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-4731ac3c-68f5-43c8-a0ff-3f6c4ba53653 tempest-ProjectMemberTests-1705931170 None] Deleting offline snapshot e001d003-3938-4129-91ac-665ba6b2292b of volume 7ecd69f0-99dd-45da-a248-73cbd5248758 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:08:57 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-4731ac3c-68f5-43c8-a0ff-3f6c4ba53653 tempest-ProjectMemberTests-1705931170 None] snapshot_file for this snap is: volume-7ecd69f0-99dd-45da-a248-73cbd5248758.e001d003-3938-4129-91ac-665ba6b2292b {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:08:57 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec8635a-f44a-452b-907a-c1c9735a3f65]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:57 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4731ac3c-68f5-43c8-a0ff-3f6c4ba53653 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758.e001d003-3938-4129-91ac-665ba6b2292b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:57 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758.e001d003-3938-4129-91ac-665ba6b2292b Nov 04 19:08:57 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:58 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4731ac3c-68f5-43c8-a0ff-3f6c4ba53653 tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758.e001d003-3938-4129-91ac-665ba6b2292b" returned: 0 in 0.408s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:58 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-4731ac3c-68f5-43c8-a0ff-3f6c4ba53653 tempest-ProjectMemberTests-1705931170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ecd69f0-99dd-45da-a248-73cbd5248758(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:08:58 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6c3a35-e1e9-4652-b245-4d61acb75da6]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4731ac3c-68f5-43c8-a0ff-3f6c4ba53653 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:58 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758 Nov 04 19:08:58 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:58 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4731ac3c-68f5-43c8-a0ff-3f6c4ba53653 tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758" returned: 0 in 0.362s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4731ac3c-68f5-43c8-a0ff-3f6c4ba53653 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758.e001d003-3938-4129-91ac-665ba6b2292b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:58 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758.e001d003-3938-4129-91ac-665ba6b2292b Nov 04 19:08:58 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:58 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4731ac3c-68f5-43c8-a0ff-3f6c4ba53653 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758.e001d003-3938-4129-91ac-665ba6b2292b" returned: 0 in 0.331s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:58 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4731ac3c-68f5-43c8-a0ff-3f6c4ba53653 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758.e001d003-3938-4129-91ac-665ba6b2292b {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:58 devstack sudo[108229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758.e001d003-3938-4129-91ac-665ba6b2292b Nov 04 19:08:58 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:59 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-4731ac3c-68f5-43c8-a0ff-3f6c4ba53653 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758.e001d003-3938-4129-91ac-665ba6b2292b" returned: 0 in 0.293s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:59 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4731ac3c-68f5-43c8-a0ff-3f6c4ba53653 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-e001d003-3938-4129-91ac-665ba6b2292b" released by "_delete_snapshot" :: held 1.513s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:59 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4731ac3c-68f5-43c8-a0ff-3f6c4ba53653 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-7ecd69f0-99dd-45da-a248-73cbd5248758" released by "delete_snapshot" :: held 1.542s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:59 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=94,cinder:UPDATE=136,cinder:INSERT=40,cinder:DELETE=11 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:08:59 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=112,cinder:UPDATE=111,cinder:INSERT=27,cinder:DELETE=11 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:08:59 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-4731ac3c-68f5-43c8-a0ff-3f6c4ba53653 tempest-ProjectMemberTests-1705931170 None] Created reservations ['2fa7d931-6750-446a-9872-0cb7197b1453', '09b9d83d-9044-4825-98ff-19e14c330c44', '646a4084-85ca-439c-b6e7-945acb1574c2', '65f6e235-c1b9-4230-b946-7cc0a02bb4a4'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:59 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-4731ac3c-68f5-43c8-a0ff-3f6c4ba53653 tempest-ProjectMemberTests-1705931170 None] Delete snapshot completed successfully. Nov 04 19:08:59 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-4731ac3c-68f5-43c8-a0ff-3f6c4ba53653 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-e001d003-3938-4129-91ac-665ba6b2292b-delete_snapshot" released by "delete_snapshot" :: held 1.714s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:59 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d61e1bf1-5c1c-4c8f-808b-65a4006fc3f6 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-7ecd69f0-99dd-45da-a248-73cbd5248758-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:59 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d61e1bf1-5c1c-4c8f-808b-65a4006fc3f6 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-7ecd69f0-99dd-45da-a248-73cbd5248758-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:59 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d61e1bf1-5c1c-4c8f-808b-65a4006fc3f6 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-quobyte-7ecd69f0-99dd-45da-a248-73cbd5248758" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:59 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d61e1bf1-5c1c-4c8f-808b-65a4006fc3f6 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-7ecd69f0-99dd-45da-a248-73cbd5248758" acquired by "delete_volume" :: waited 0.021s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:59 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ff9ad7-d9b2-4779-be0f-e3da69b371d4]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:59 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d61e1bf1-5c1c-4c8f-808b-65a4006fc3f6 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:59 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758 Nov 04 19:08:59 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:00 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d61e1bf1-5c1c-4c8f-808b-65a4006fc3f6 tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758" returned: 0 in 0.399s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d61e1bf1-5c1c-4c8f-808b-65a4006fc3f6 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:00 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758 Nov 04 19:09:00 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:00 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d61e1bf1-5c1c-4c8f-808b-65a4006fc3f6 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-7ecd69f0-99dd-45da-a248-73cbd5248758" returned: 0 in 0.271s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:00 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d61e1bf1-5c1c-4c8f-808b-65a4006fc3f6 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-7ecd69f0-99dd-45da-a248-73cbd5248758" released by "delete_volume" :: held 0.753s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:00 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-d61e1bf1-5c1c-4c8f-808b-65a4006fc3f6 tempest-ProjectMemberTests-1705931170 None] Created reservations ['93c187a0-20b2-468d-b570-1aec558005fc', '68a7af5d-50cc-4b12-8c40-808709f4df27', '54b3dd63-6fb6-478a-ad4c-b893a4c92005', '109fd0c2-85ab-4c35-a621-321a2b8747d2'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:09:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d61e1bf1-5c1c-4c8f-808b-65a4006fc3f6 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d61e1bf1-5c1c-4c8f-808b-65a4006fc3f6 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:00 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d61e1bf1-5c1c-4c8f-808b-65a4006fc3f6 tempest-ProjectMemberTests-1705931170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:09:00 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-d61e1bf1-5c1c-4c8f-808b-65a4006fc3f6 tempest-ProjectMemberTests-1705931170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:09:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-d61e1bf1-5c1c-4c8f-808b-65a4006fc3f6 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d61e1bf1-5c1c-4c8f-808b-65a4006fc3f6 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:00 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:09:00 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:00 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:00 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-d61e1bf1-5c1c-4c8f-808b-65a4006fc3f6 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.291s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:00 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-d61e1bf1-5c1c-4c8f-808b-65a4006fc3f6 tempest-ProjectMemberTests-1705931170 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:09:00 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-d61e1bf1-5c1c-4c8f-808b-65a4006fc3f6 tempest-ProjectMemberTests-1705931170 None] Deleted volume successfully. Nov 04 19:09:00 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-d61e1bf1-5c1c-4c8f-808b-65a4006fc3f6 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-7ecd69f0-99dd-45da-a248-73cbd5248758-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:01 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:09:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Flow 'volume_create_manager' (01ba242c-a6ae-4286-8a2d-8e7abc709f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:09:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a78b17c7-8397-4dea-95d8-014807c83e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a78b17c7-8397-4dea-95d8-014807c83e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1640252674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fa1a976-59e6-40b3-a51b-882e2604133a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eea4506f7224002863cfaf3510e93b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:09:01Z,use_quota=True,user_id='cd1b5ab70cb74972a3562eb0a2e88be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0768360-1ff5-4e52-ae01-e188b658a992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0768360-1ff5-4e52-ae01-e188b658a992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273ac218-7c5f-48b6-9bc5-1ae1e659448b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273ac218-7c5f-48b6-9bc5-1ae1e659448b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fa1a976-59e6-40b3-a51b-882e2604133a', 'volume_name': 'volume-1fa1a976-59e6-40b3-a51b-882e2604133a', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238ae98c-4393-4043-8095-0765e07cdb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238ae98c-4393-4043-8095-0765e07cdb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:01 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84c30f60-ce82-4572-af31-76f607aa3074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:01 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Volume 1fa1a976-59e6-40b3-a51b-882e2604133a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fa1a976-59e6-40b3-a51b-882e2604133a', 'volume_size': 1} Nov 04 19:09:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:01 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1640252674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fa1a976-59e6-40b3-a51b-882e2604133a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eea4506f7224002863cfaf3510e93b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:09:01Z,use_quota=True,user_id='cd1b5ab70cb74972a3562eb0a2e88be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:09:01 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Creating volume 1fa1a976-59e6-40b3-a51b-882e2604133a {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:09:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:01 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:09:01 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:09:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:01 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:09:01 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:09:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:01 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a 1073741824 Nov 04 19:09:01 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:01 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:01 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a 1073741824" returned: 0 in 0.474s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:02 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a Nov 04 19:09:02 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:02 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a" returned: 0 in 0.249s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:02 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:09:02 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84c30f60-ce82-4572-af31-76f607aa3074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fa1a976-59e6-40b3-a51b-882e2604133a', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b0aae6-1106-4146-9500-e038ad097ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:02 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Volume volume-1fa1a976-59e6-40b3-a51b-882e2604133a (1fa1a976-59e6-40b3-a51b-882e2604133a): created successfully Nov 04 19:09:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b0aae6-1106-4146-9500-e038ad097ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:02 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Flow 'volume_create_manager' (01ba242c-a6ae-4286-8a2d-8e7abc709f68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:09:02 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-ce5a3361-3143-43af-a287-f0eefb20a5fe tempest-ProjectMemberTests-1705931170 None] Created volume successfully. Nov 04 19:09:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e1d629bb-5d9e-4a88-9e3b-9b8e99d02c55 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e1d629bb-5d9e-4a88-9e3b-9b8e99d02c55 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:03 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-e1d629bb-5d9e-4a88-9e3b-9b8e99d02c55 tempest-ProjectMemberTests-1705931170 None] Creating offline snapshot 2dbc9bc8-52e9-479a-8d52-b63189377197 of volume 1fa1a976-59e6-40b3-a51b-882e2604133a {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:09:03 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b221ba8-dd7a-4be3-a790-bf2f8297884f]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:03 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e1d629bb-5d9e-4a88-9e3b-9b8e99d02c55 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:03 devstack sudo[108256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a Nov 04 19:09:03 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:04 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e1d629bb-5d9e-4a88-9e3b-9b8e99d02c55 tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a" returned: 0 in 0.375s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e1d629bb-5d9e-4a88-9e3b-9b8e99d02c55 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a.2dbc9bc8-52e9-479a-8d52-b63189377197 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:04 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a.2dbc9bc8-52e9-479a-8d52-b63189377197 1G Nov 04 19:09:04 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:04 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e1d629bb-5d9e-4a88-9e3b-9b8e99d02c55 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a.2dbc9bc8-52e9-479a-8d52-b63189377197 1G" returned: 0 in 0.383s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e1d629bb-5d9e-4a88-9e3b-9b8e99d02c55 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fa1a976-59e6-40b3-a51b-882e2604133a -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a.2dbc9bc8-52e9-479a-8d52-b63189377197 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:04 devstack sudo[108268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fa1a976-59e6-40b3-a51b-882e2604133a -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a.2dbc9bc8-52e9-479a-8d52-b63189377197 Nov 04 19:09:04 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:04 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e1d629bb-5d9e-4a88-9e3b-9b8e99d02c55 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fa1a976-59e6-40b3-a51b-882e2604133a -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a.2dbc9bc8-52e9-479a-8d52-b63189377197" returned: 0 in 0.284s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:04 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-e1d629bb-5d9e-4a88-9e3b-9b8e99d02c55 tempest-ProjectMemberTests-1705931170 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a.2dbc9bc8-52e9-479a-8d52-b63189377197 is being set with open permissions: ugo+rw Nov 04 19:09:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e1d629bb-5d9e-4a88-9e3b-9b8e99d02c55 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a.2dbc9bc8-52e9-479a-8d52-b63189377197 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:04 devstack sudo[108273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a.2dbc9bc8-52e9-479a-8d52-b63189377197 Nov 04 19:09:04 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:04 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e1d629bb-5d9e-4a88-9e3b-9b8e99d02c55 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a.2dbc9bc8-52e9-479a-8d52-b63189377197" returned: 0 in 0.235s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:04 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e1d629bb-5d9e-4a88-9e3b-9b8e99d02c55 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:04 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a.info Nov 04 19:09:04 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:05 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e1d629bb-5d9e-4a88-9e3b-9b8e99d02c55 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a.info" returned: 0 in 0.248s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:05 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-e1d629bb-5d9e-4a88-9e3b-9b8e99d02c55 tempest-ProjectMemberTests-1705931170 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a.info is being set with open permissions: ugo+rw Nov 04 19:09:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e1d629bb-5d9e-4a88-9e3b-9b8e99d02c55 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:05 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a.info Nov 04 19:09:05 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:05 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e1d629bb-5d9e-4a88-9e3b-9b8e99d02c55 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a.info" returned: 0 in 0.239s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e1d629bb-5d9e-4a88-9e3b-9b8e99d02c55 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.846s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:05 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e1d629bb-5d9e-4a88-9e3b-9b8e99d02c55 tempest-ProjectMemberTests-1705931170 None] Create snapshot completed successfully Nov 04 19:09:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1cfcaa7a-a94f-45c7-b604-16cd52b5a3b1 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-2dbc9bc8-52e9-479a-8d52-b63189377197-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1cfcaa7a-a94f-45c7-b604-16cd52b5a3b1 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-2dbc9bc8-52e9-479a-8d52-b63189377197-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1cfcaa7a-a94f-45c7-b604-16cd52b5a3b1 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-quobyte-1fa1a976-59e6-40b3-a51b-882e2604133a" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1cfcaa7a-a94f-45c7-b604-16cd52b5a3b1 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-1fa1a976-59e6-40b3-a51b-882e2604133a" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1cfcaa7a-a94f-45c7-b604-16cd52b5a3b1 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-quobyte-2dbc9bc8-52e9-479a-8d52-b63189377197" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:05 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1cfcaa7a-a94f-45c7-b604-16cd52b5a3b1 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-2dbc9bc8-52e9-479a-8d52-b63189377197" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-1cfcaa7a-a94f-45c7-b604-16cd52b5a3b1 tempest-ProjectMemberTests-1705931170 None] Deleting offline snapshot 2dbc9bc8-52e9-479a-8d52-b63189377197 of volume 1fa1a976-59e6-40b3-a51b-882e2604133a {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:09:05 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-1cfcaa7a-a94f-45c7-b604-16cd52b5a3b1 tempest-ProjectMemberTests-1705931170 None] snapshot_file for this snap is: volume-1fa1a976-59e6-40b3-a51b-882e2604133a.2dbc9bc8-52e9-479a-8d52-b63189377197 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:09:05 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed67bba7-1174-4bfe-aa6b-9f22faaef11a]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:05 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1cfcaa7a-a94f-45c7-b604-16cd52b5a3b1 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a.2dbc9bc8-52e9-479a-8d52-b63189377197 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:05 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a.2dbc9bc8-52e9-479a-8d52-b63189377197 Nov 04 19:09:05 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:06 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1cfcaa7a-a94f-45c7-b604-16cd52b5a3b1 tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a.2dbc9bc8-52e9-479a-8d52-b63189377197" returned: 0 in 0.354s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:06 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-1cfcaa7a-a94f-45c7-b604-16cd52b5a3b1 tempest-ProjectMemberTests-1705931170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fa1a976-59e6-40b3-a51b-882e2604133a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:09:06 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4219d00f-b0e4-43c1-b834-c660a14d9976]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1cfcaa7a-a94f-45c7-b604-16cd52b5a3b1 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:06 devstack sudo[108287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a Nov 04 19:09:06 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:06 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1cfcaa7a-a94f-45c7-b604-16cd52b5a3b1 tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a" returned: 0 in 0.356s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1cfcaa7a-a94f-45c7-b604-16cd52b5a3b1 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a.2dbc9bc8-52e9-479a-8d52-b63189377197 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:06 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a.2dbc9bc8-52e9-479a-8d52-b63189377197 Nov 04 19:09:06 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:06 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1cfcaa7a-a94f-45c7-b604-16cd52b5a3b1 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a.2dbc9bc8-52e9-479a-8d52-b63189377197" returned: 0 in 0.328s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:06 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1cfcaa7a-a94f-45c7-b604-16cd52b5a3b1 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a.2dbc9bc8-52e9-479a-8d52-b63189377197 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:06 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a.2dbc9bc8-52e9-479a-8d52-b63189377197 Nov 04 19:09:06 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:07 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:07 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1cfcaa7a-a94f-45c7-b604-16cd52b5a3b1 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a.2dbc9bc8-52e9-479a-8d52-b63189377197" returned: 0 in 0.260s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1cfcaa7a-a94f-45c7-b604-16cd52b5a3b1 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-2dbc9bc8-52e9-479a-8d52-b63189377197" released by "_delete_snapshot" :: held 1.394s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1cfcaa7a-a94f-45c7-b604-16cd52b5a3b1 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-1fa1a976-59e6-40b3-a51b-882e2604133a" released by "delete_snapshot" :: held 1.412s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:07 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-1cfcaa7a-a94f-45c7-b604-16cd52b5a3b1 tempest-ProjectMemberTests-1705931170 None] Created reservations ['3e41d0af-d94b-4b41-b293-abea5d663003', 'd2a85756-f0b8-425d-98b9-16d4fa8e7905', '0ec5fdd8-825b-4699-a950-0d8a2251e521', '8f72c9ec-08bf-4f77-8e59-e4f0843025d7'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:09:07 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-1cfcaa7a-a94f-45c7-b604-16cd52b5a3b1 tempest-ProjectMemberTests-1705931170 None] Delete snapshot completed successfully. Nov 04 19:09:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-1cfcaa7a-a94f-45c7-b604-16cd52b5a3b1 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-2dbc9bc8-52e9-479a-8d52-b63189377197-delete_snapshot" released by "delete_snapshot" :: held 1.537s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2b0f92f9-d6cd-4b31-be7b-048f7849c15c tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-1fa1a976-59e6-40b3-a51b-882e2604133a-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2b0f92f9-d6cd-4b31-be7b-048f7849c15c tempest-ProjectMemberTests-1705931170 None] Lock "cinder-1fa1a976-59e6-40b3-a51b-882e2604133a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2b0f92f9-d6cd-4b31-be7b-048f7849c15c tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-quobyte-1fa1a976-59e6-40b3-a51b-882e2604133a" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:07 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2b0f92f9-d6cd-4b31-be7b-048f7849c15c tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-1fa1a976-59e6-40b3-a51b-882e2604133a" acquired by "delete_volume" :: waited 0.014s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:08 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a20573-980d-4e27-8b13-3b23c13944c2]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2b0f92f9-d6cd-4b31-be7b-048f7849c15c tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:08 devstack sudo[108302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a Nov 04 19:09:08 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:08 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2b0f92f9-d6cd-4b31-be7b-048f7849c15c tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a" returned: 0 in 0.345s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2b0f92f9-d6cd-4b31-be7b-048f7849c15c tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:08 devstack sudo[108307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a Nov 04 19:09:08 devstack sudo[108307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:08 devstack sudo[108307]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2b0f92f9-d6cd-4b31-be7b-048f7849c15c tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-1fa1a976-59e6-40b3-a51b-882e2604133a" returned: 0 in 0.230s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2b0f92f9-d6cd-4b31-be7b-048f7849c15c tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-1fa1a976-59e6-40b3-a51b-882e2604133a" released by "delete_volume" :: held 0.631s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:08 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-2b0f92f9-d6cd-4b31-be7b-048f7849c15c tempest-ProjectMemberTests-1705931170 None] Created reservations ['82b2c262-972d-4052-bcf4-083900bc83fc', '869675de-422d-40dc-baa2-f0971c7fa6ed', '7022d230-7fb6-4a48-af97-0714e13416c9', '1b2e2ebf-1337-4987-a7e7-f44293b98c3a'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:09:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2b0f92f9-d6cd-4b31-be7b-048f7849c15c tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2b0f92f9-d6cd-4b31-be7b-048f7849c15c tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2b0f92f9-d6cd-4b31-be7b-048f7849c15c tempest-ProjectMemberTests-1705931170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:09:08 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-2b0f92f9-d6cd-4b31-be7b-048f7849c15c tempest-ProjectMemberTests-1705931170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:09:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-2b0f92f9-d6cd-4b31-be7b-048f7849c15c tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2b0f92f9-d6cd-4b31-be7b-048f7849c15c tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:08 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:09:08 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:08 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:08 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-2b0f92f9-d6cd-4b31-be7b-048f7849c15c tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.225s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:08 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-2b0f92f9-d6cd-4b31-be7b-048f7849c15c tempest-ProjectMemberTests-1705931170 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:09:08 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-2b0f92f9-d6cd-4b31-be7b-048f7849c15c tempest-ProjectMemberTests-1705931170 None] Deleted volume successfully. Nov 04 19:09:08 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-2b0f92f9-d6cd-4b31-be7b-048f7849c15c tempest-ProjectMemberTests-1705931170 None] Lock "cinder-1fa1a976-59e6-40b3-a51b-882e2604133a-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:09 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:09:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Flow 'volume_create_manager' (b1a894e6-5c60-47df-8ccf-299c18763eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:09:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a47dbd5b-0739-4367-a260-26e9805b74a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a47dbd5b-0739-4367-a260-26e9805b74a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1230072996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd15029b-a9d4-4319-9abb-ea67b265e97d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eea4506f7224002863cfaf3510e93b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:09:09Z,use_quota=True,user_id='cd1b5ab70cb74972a3562eb0a2e88be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d357bd-02be-4e93-ab51-27dc35b13977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d357bd-02be-4e93-ab51-27dc35b13977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b63d68-49f9-4259-b70f-241de016827a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b63d68-49f9-4259-b70f-241de016827a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd15029b-a9d4-4319-9abb-ea67b265e97d', 'volume_name': 'volume-cd15029b-a9d4-4319-9abb-ea67b265e97d', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f2a8d1-6698-4ee1-b3fd-cdbf3fb697ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f2a8d1-6698-4ee1-b3fd-cdbf3fb697ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:09 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd901fad-3c9d-4aca-b29c-6dfd02445856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:09 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Volume cd15029b-a9d4-4319-9abb-ea67b265e97d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd15029b-a9d4-4319-9abb-ea67b265e97d', 'volume_size': 1} Nov 04 19:09:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1230072996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd15029b-a9d4-4319-9abb-ea67b265e97d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eea4506f7224002863cfaf3510e93b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:09:09Z,use_quota=True,user_id='cd1b5ab70cb74972a3562eb0a2e88be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:09:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Creating volume cd15029b-a9d4-4319-9abb-ea67b265e97d {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:09:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:09:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:09:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:09 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:09:09 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:09:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:09 devstack sudo[108313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d 1073741824 Nov 04 19:09:09 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:09 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:09 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d 1073741824" returned: 0 in 0.413s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:10 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d Nov 04 19:09:10 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:10 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d" returned: 0 in 0.247s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:09:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd901fad-3c9d-4aca-b29c-6dfd02445856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd15029b-a9d4-4319-9abb-ea67b265e97d', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fe37f60-d30f-442f-aad7-06151693bd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:10 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Volume volume-cd15029b-a9d4-4319-9abb-ea67b265e97d (cd15029b-a9d4-4319-9abb-ea67b265e97d): created successfully Nov 04 19:09:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fe37f60-d30f-442f-aad7-06151693bd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:10 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Flow 'volume_create_manager' (b1a894e6-5c60-47df-8ccf-299c18763eef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:09:10 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-e06dee27-0f9b-4be3-b5f1-84b5334bfdf2 tempest-ProjectMemberTests-1705931170 None] Created volume successfully. Nov 04 19:09:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1bd950af-387d-481f-9df7-cd513feb581f tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1bd950af-387d-481f-9df7-cd513feb581f tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:10 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-1bd950af-387d-481f-9df7-cd513feb581f tempest-ProjectMemberTests-1705931170 None] Creating offline snapshot 426965d4-af99-4262-a7b0-de8a98f5c2b2 of volume cd15029b-a9d4-4319-9abb-ea67b265e97d {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:09:10 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3063b7-43e9-404e-a3b3-09c94d72a42e]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:10 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1bd950af-387d-481f-9df7-cd513feb581f tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:10 devstack sudo[108322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d Nov 04 19:09:10 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:11 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1bd950af-387d-481f-9df7-cd513feb581f tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d" returned: 0 in 0.366s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1bd950af-387d-481f-9df7-cd513feb581f tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d.426965d4-af99-4262-a7b0-de8a98f5c2b2 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:11 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d.426965d4-af99-4262-a7b0-de8a98f5c2b2 1G Nov 04 19:09:11 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:11 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1bd950af-387d-481f-9df7-cd513feb581f tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d.426965d4-af99-4262-a7b0-de8a98f5c2b2 1G" returned: 0 in 0.388s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1bd950af-387d-481f-9df7-cd513feb581f tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd15029b-a9d4-4319-9abb-ea67b265e97d -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d.426965d4-af99-4262-a7b0-de8a98f5c2b2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:11 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd15029b-a9d4-4319-9abb-ea67b265e97d -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d.426965d4-af99-4262-a7b0-de8a98f5c2b2 Nov 04 19:09:11 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:11 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1bd950af-387d-481f-9df7-cd513feb581f tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd15029b-a9d4-4319-9abb-ea67b265e97d -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d.426965d4-af99-4262-a7b0-de8a98f5c2b2" returned: 0 in 0.284s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:11 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-1bd950af-387d-481f-9df7-cd513feb581f tempest-ProjectMemberTests-1705931170 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d.426965d4-af99-4262-a7b0-de8a98f5c2b2 is being set with open permissions: ugo+rw Nov 04 19:09:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1bd950af-387d-481f-9df7-cd513feb581f tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d.426965d4-af99-4262-a7b0-de8a98f5c2b2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:11 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d.426965d4-af99-4262-a7b0-de8a98f5c2b2 Nov 04 19:09:11 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:11 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1bd950af-387d-481f-9df7-cd513feb581f tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d.426965d4-af99-4262-a7b0-de8a98f5c2b2" returned: 0 in 0.249s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:11 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1bd950af-387d-481f-9df7-cd513feb581f tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:11 devstack sudo[108342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d.info Nov 04 19:09:11 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:12 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1bd950af-387d-481f-9df7-cd513feb581f tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d.info" returned: 0 in 0.233s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:12 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-1bd950af-387d-481f-9df7-cd513feb581f tempest-ProjectMemberTests-1705931170 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d.info is being set with open permissions: ugo+rw Nov 04 19:09:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1bd950af-387d-481f-9df7-cd513feb581f tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:12 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d.info Nov 04 19:09:12 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:12 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-1bd950af-387d-481f-9df7-cd513feb581f tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d.info" returned: 0 in 0.247s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-1bd950af-387d-481f-9df7-cd513feb581f tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.848s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:12 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-1bd950af-387d-481f-9df7-cd513feb581f tempest-ProjectMemberTests-1705931170 None] Create snapshot completed successfully Nov 04 19:09:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9b610ef3-56ad-4279-8dd0-595b2d5b8aed tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-426965d4-af99-4262-a7b0-de8a98f5c2b2-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9b610ef3-56ad-4279-8dd0-595b2d5b8aed tempest-ProjectMemberTests-1705931170 None] Lock "cinder-426965d4-af99-4262-a7b0-de8a98f5c2b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9b610ef3-56ad-4279-8dd0-595b2d5b8aed tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-quobyte-cd15029b-a9d4-4319-9abb-ea67b265e97d" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9b610ef3-56ad-4279-8dd0-595b2d5b8aed tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-cd15029b-a9d4-4319-9abb-ea67b265e97d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9b610ef3-56ad-4279-8dd0-595b2d5b8aed tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-quobyte-426965d4-af99-4262-a7b0-de8a98f5c2b2" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:12 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9b610ef3-56ad-4279-8dd0-595b2d5b8aed tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-426965d4-af99-4262-a7b0-de8a98f5c2b2" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:12 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-9b610ef3-56ad-4279-8dd0-595b2d5b8aed tempest-ProjectMemberTests-1705931170 None] Deleting offline snapshot 426965d4-af99-4262-a7b0-de8a98f5c2b2 of volume cd15029b-a9d4-4319-9abb-ea67b265e97d {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:09:12 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-9b610ef3-56ad-4279-8dd0-595b2d5b8aed tempest-ProjectMemberTests-1705931170 None] snapshot_file for this snap is: volume-cd15029b-a9d4-4319-9abb-ea67b265e97d.426965d4-af99-4262-a7b0-de8a98f5c2b2 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:09:12 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0417219d-ed6c-4474-ac2b-f68e75e1d761]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:12 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9b610ef3-56ad-4279-8dd0-595b2d5b8aed tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d.426965d4-af99-4262-a7b0-de8a98f5c2b2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:12 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d.426965d4-af99-4262-a7b0-de8a98f5c2b2 Nov 04 19:09:12 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:13 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9b610ef3-56ad-4279-8dd0-595b2d5b8aed tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d.426965d4-af99-4262-a7b0-de8a98f5c2b2" returned: 0 in 0.336s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:13 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-9b610ef3-56ad-4279-8dd0-595b2d5b8aed tempest-ProjectMemberTests-1705931170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd15029b-a9d4-4319-9abb-ea67b265e97d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:09:13 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f6cf7c-b325-44aa-8de6-7d58fe51084b]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9b610ef3-56ad-4279-8dd0-595b2d5b8aed tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:13 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d Nov 04 19:09:13 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:13 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9b610ef3-56ad-4279-8dd0-595b2d5b8aed tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d" returned: 0 in 0.337s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9b610ef3-56ad-4279-8dd0-595b2d5b8aed tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d.426965d4-af99-4262-a7b0-de8a98f5c2b2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:13 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d.426965d4-af99-4262-a7b0-de8a98f5c2b2 Nov 04 19:09:13 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:13 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9b610ef3-56ad-4279-8dd0-595b2d5b8aed tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d.426965d4-af99-4262-a7b0-de8a98f5c2b2" returned: 0 in 0.323s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:13 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9b610ef3-56ad-4279-8dd0-595b2d5b8aed tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d.426965d4-af99-4262-a7b0-de8a98f5c2b2 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:13 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d.426965d4-af99-4262-a7b0-de8a98f5c2b2 Nov 04 19:09:13 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:14 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:14 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-9b610ef3-56ad-4279-8dd0-595b2d5b8aed tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d.426965d4-af99-4262-a7b0-de8a98f5c2b2" returned: 0 in 0.243s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9b610ef3-56ad-4279-8dd0-595b2d5b8aed tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-426965d4-af99-4262-a7b0-de8a98f5c2b2" released by "_delete_snapshot" :: held 1.333s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9b610ef3-56ad-4279-8dd0-595b2d5b8aed tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-cd15029b-a9d4-4319-9abb-ea67b265e97d" released by "delete_snapshot" :: held 1.352s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:14 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-9b610ef3-56ad-4279-8dd0-595b2d5b8aed tempest-ProjectMemberTests-1705931170 None] Created reservations ['eef1b3c4-1a5c-4551-b893-6da3609810d0', '5bde831f-9ce9-4589-b678-20c3800c2245', '4b1e7bb3-7f34-4b6b-a016-a43250a4ccff', '9fb6d2b4-a29a-4a0b-bd62-305e85fcf31c'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:09:14 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-9b610ef3-56ad-4279-8dd0-595b2d5b8aed tempest-ProjectMemberTests-1705931170 None] Delete snapshot completed successfully. Nov 04 19:09:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-9b610ef3-56ad-4279-8dd0-595b2d5b8aed tempest-ProjectMemberTests-1705931170 None] Lock "cinder-426965d4-af99-4262-a7b0-de8a98f5c2b2-delete_snapshot" released by "delete_snapshot" :: held 1.477s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-8d74ec3c-645c-498c-b305-527e2c6b4ff8 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-cd15029b-a9d4-4319-9abb-ea67b265e97d-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-8d74ec3c-645c-498c-b305-527e2c6b4ff8 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-cd15029b-a9d4-4319-9abb-ea67b265e97d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-8d74ec3c-645c-498c-b305-527e2c6b4ff8 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-quobyte-cd15029b-a9d4-4319-9abb-ea67b265e97d" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:14 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-8d74ec3c-645c-498c-b305-527e2c6b4ff8 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-cd15029b-a9d4-4319-9abb-ea67b265e97d" acquired by "delete_volume" :: waited 0.017s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:15 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aebdd0c-3f94-43a1-8ea5-708565d25fbf]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8d74ec3c-645c-498c-b305-527e2c6b4ff8 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:15 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d Nov 04 19:09:15 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:15 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8d74ec3c-645c-498c-b305-527e2c6b4ff8 tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d" returned: 0 in 0.333s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8d74ec3c-645c-498c-b305-527e2c6b4ff8 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:15 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d Nov 04 19:09:15 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:15 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8d74ec3c-645c-498c-b305-527e2c6b4ff8 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-cd15029b-a9d4-4319-9abb-ea67b265e97d" returned: 0 in 0.243s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:15 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-8d74ec3c-645c-498c-b305-527e2c6b4ff8 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-cd15029b-a9d4-4319-9abb-ea67b265e97d" released by "delete_volume" :: held 0.632s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:15 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-8d74ec3c-645c-498c-b305-527e2c6b4ff8 tempest-ProjectMemberTests-1705931170 None] Created reservations ['56eefe81-98a2-4f90-893e-f6d3c956f6d0', 'bf0b036e-491a-428e-96f8-034a61265440', '12956134-e2df-4d2e-a685-b8e013c889cc', 'a8e6a9ba-06b0-449c-86e5-e84830fa25c9'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:09:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8d74ec3c-645c-498c-b305-527e2c6b4ff8 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8d74ec3c-645c-498c-b305-527e2c6b4ff8 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:15 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8d74ec3c-645c-498c-b305-527e2c6b4ff8 tempest-ProjectMemberTests-1705931170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:09:15 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-8d74ec3c-645c-498c-b305-527e2c6b4ff8 tempest-ProjectMemberTests-1705931170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:09:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-8d74ec3c-645c-498c-b305-527e2c6b4ff8 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8d74ec3c-645c-498c-b305-527e2c6b4ff8 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:15 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:09:15 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:15 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:15 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-8d74ec3c-645c-498c-b305-527e2c6b4ff8 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.231s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:15 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-8d74ec3c-645c-498c-b305-527e2c6b4ff8 tempest-ProjectMemberTests-1705931170 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:09:15 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-8d74ec3c-645c-498c-b305-527e2c6b4ff8 tempest-ProjectMemberTests-1705931170 None] Deleted volume successfully. Nov 04 19:09:15 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-8d74ec3c-645c-498c-b305-527e2c6b4ff8 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-cd15029b-a9d4-4319-9abb-ea67b265e97d-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:16 devstack cinder-volume[87119]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:09:16 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Flow 'volume_create_manager' (36116bf5-f605-4341-86b5-9e38d5b5e7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:09:16 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd33b9a-57e6-4a10-b867-1f5d5e8a6be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:16 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd33b9a-57e6-4a10-b867-1f5d5e8a6be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-865383613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2043c507-d3e4-41d4-9006-dcb4bf29d54e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eea4506f7224002863cfaf3510e93b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:09:16Z,use_quota=True,user_id='cd1b5ab70cb74972a3562eb0a2e88be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:16 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b997486c-3168-495f-8bee-e22c4fc23bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:16 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b997486c-3168-495f-8bee-e22c4fc23bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:16 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9021a6-d928-4bd4-ac9e-c305fb324e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:16 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9021a6-d928-4bd4-ac9e-c305fb324e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2043c507-d3e4-41d4-9006-dcb4bf29d54e', 'volume_name': 'volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:16 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c665fa-109b-442c-8e02-279d4dbf5178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:16 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c665fa-109b-442c-8e02-279d4dbf5178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:16 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4bfdc79-c3dc-40ed-b7ff-a34f525126c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:16 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Volume 2043c507-d3e4-41d4-9006-dcb4bf29d54e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e', 'volume_size': 1} Nov 04 19:09:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:16 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-865383613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2043c507-d3e4-41d4-9006-dcb4bf29d54e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eea4506f7224002863cfaf3510e93b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:09:16Z,use_quota=True,user_id='cd1b5ab70cb74972a3562eb0a2e88be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(923bc015-a5bf-47da-aa99-4f28d98b2912),volume_type_id=923bc015-a5bf-47da-aa99-4f28d98b2912)}" {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:09:16 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Creating volume 2043c507-d3e4-41d4-9006-dcb4bf29d54e {{(pid=87119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:09:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:16 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:09:16 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:09:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:16 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Selected osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 as target Quobyte volume. {{(pid=87119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:09:16 devstack cinder-volume[87119]: INFO cinder.volume.drivers.remotefs [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] casted to osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280 Nov 04 19:09:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e 1073741824 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:16 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e 1073741824 Nov 04 19:09:16 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:16 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:16 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e 1073741824" returned: 0 in 0.400s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:17 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e Nov 04 19:09:17 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:17 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e" returned: 0 in 0.227s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:17 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'} {{(pid=87119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:09:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:17 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4bfdc79-c3dc-40ed-b7ff-a34f525126c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e', 'volume_size': 1}' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:17 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b197371e-cb54-469d-acd9-8266db4b3732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:17 devstack cinder-volume[87119]: INFO cinder.volume.flows.manager.create_volume [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Volume volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e (2043c507-d3e4-41d4-9006-dcb4bf29d54e): created successfully Nov 04 19:09:17 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b197371e-cb54-469d-acd9-8266db4b3732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:17 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Flow 'volume_create_manager' (36116bf5-f605-4341-86b5-9e38d5b5e7a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:09:17 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-f5f94334-4fa9-4bb3-97f2-27229594a527 tempest-ProjectMemberTests-1705931170 None] Created volume successfully. Nov 04 19:09:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-54578c00-600e-49b3-ac5f-b4eddbb54e73 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-54578c00-600e-49b3-ac5f-b4eddbb54e73 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:17 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-54578c00-600e-49b3-ac5f-b4eddbb54e73 tempest-ProjectMemberTests-1705931170 None] Creating offline snapshot ecaa8918-0fa7-41e3-8c5f-7d8c1204ff02 of volume 2043c507-d3e4-41d4-9006-dcb4bf29d54e {{(pid=87119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:09:17 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e4d6fa-d574-4e37-9033-6174e035df83]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:17 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-54578c00-600e-49b3-ac5f-b4eddbb54e73 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:17 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e Nov 04 19:09:17 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:18 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-54578c00-600e-49b3-ac5f-b4eddbb54e73 tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e" returned: 0 in 0.348s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-54578c00-600e-49b3-ac5f-b4eddbb54e73 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e.ecaa8918-0fa7-41e3-8c5f-7d8c1204ff02 1G {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:18 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e.ecaa8918-0fa7-41e3-8c5f-7d8c1204ff02 1G Nov 04 19:09:18 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:18 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-54578c00-600e-49b3-ac5f-b4eddbb54e73 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e.ecaa8918-0fa7-41e3-8c5f-7d8c1204ff02 1G" returned: 0 in 0.375s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-54578c00-600e-49b3-ac5f-b4eddbb54e73 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e.ecaa8918-0fa7-41e3-8c5f-7d8c1204ff02 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:18 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e.ecaa8918-0fa7-41e3-8c5f-7d8c1204ff02 Nov 04 19:09:18 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:18 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-54578c00-600e-49b3-ac5f-b4eddbb54e73 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e -F qcow2 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e.ecaa8918-0fa7-41e3-8c5f-7d8c1204ff02" returned: 0 in 0.276s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:18 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-54578c00-600e-49b3-ac5f-b4eddbb54e73 tempest-ProjectMemberTests-1705931170 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e.ecaa8918-0fa7-41e3-8c5f-7d8c1204ff02 is being set with open permissions: ugo+rw Nov 04 19:09:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-54578c00-600e-49b3-ac5f-b4eddbb54e73 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e.ecaa8918-0fa7-41e3-8c5f-7d8c1204ff02 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:18 devstack sudo[108403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e.ecaa8918-0fa7-41e3-8c5f-7d8c1204ff02 Nov 04 19:09:18 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:18 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-54578c00-600e-49b3-ac5f-b4eddbb54e73 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e.ecaa8918-0fa7-41e3-8c5f-7d8c1204ff02" returned: 0 in 0.243s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:18 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-54578c00-600e-49b3-ac5f-b4eddbb54e73 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:18 devstack sudo[108406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e.info Nov 04 19:09:18 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:19 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-54578c00-600e-49b3-ac5f-b4eddbb54e73 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e.info" returned: 0 in 0.242s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:19 devstack cinder-volume[87119]: WARNING cinder.volume.drivers.remotefs [None req-54578c00-600e-49b3-ac5f-b4eddbb54e73 tempest-ProjectMemberTests-1705931170 None] /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e.info is being set with open permissions: ugo+rw Nov 04 19:09:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-54578c00-600e-49b3-ac5f-b4eddbb54e73 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e.info {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:19 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e.info Nov 04 19:09:19 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:19 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-54578c00-600e-49b3-ac5f-b4eddbb54e73 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e.info" returned: 0 in 0.242s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-54578c00-600e-49b3-ac5f-b4eddbb54e73 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.808s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:19 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-54578c00-600e-49b3-ac5f-b4eddbb54e73 tempest-ProjectMemberTests-1705931170 None] Create snapshot completed successfully Nov 04 19:09:19 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f1a0545c-3c11-4534-8114-822237c146f5 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-ecaa8918-0fa7-41e3-8c5f-7d8c1204ff02-delete_snapshot" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:19 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f1a0545c-3c11-4534-8114-822237c146f5 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-ecaa8918-0fa7-41e3-8c5f-7d8c1204ff02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:19 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f1a0545c-3c11-4534-8114-822237c146f5 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-quobyte-2043c507-d3e4-41d4-9006-dcb4bf29d54e" by "delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:19 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f1a0545c-3c11-4534-8114-822237c146f5 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-2043c507-d3e4-41d4-9006-dcb4bf29d54e" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:19 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f1a0545c-3c11-4534-8114-822237c146f5 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-quobyte-ecaa8918-0fa7-41e3-8c5f-7d8c1204ff02" by "_delete_snapshot" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:19 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f1a0545c-3c11-4534-8114-822237c146f5 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-ecaa8918-0fa7-41e3-8c5f-7d8c1204ff02" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:19 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-f1a0545c-3c11-4534-8114-822237c146f5 tempest-ProjectMemberTests-1705931170 None] Deleting offline snapshot ecaa8918-0fa7-41e3-8c5f-7d8c1204ff02 of volume 2043c507-d3e4-41d4-9006-dcb4bf29d54e {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:09:19 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-f1a0545c-3c11-4534-8114-822237c146f5 tempest-ProjectMemberTests-1705931170 None] snapshot_file for this snap is: volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e.ecaa8918-0fa7-41e3-8c5f-7d8c1204ff02 {{(pid=87119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:09:19 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[1677f360-4fa6-46d8-9ee1-0e62553e53e1]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:19 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f1a0545c-3c11-4534-8114-822237c146f5 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e.ecaa8918-0fa7-41e3-8c5f-7d8c1204ff02 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:20 devstack sudo[108412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e.ecaa8918-0fa7-41e3-8c5f-7d8c1204ff02 Nov 04 19:09:20 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:20 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f1a0545c-3c11-4534-8114-822237c146f5 tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e.ecaa8918-0fa7-41e3-8c5f-7d8c1204ff02" returned: 0 in 0.356s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:20 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.remotefs [None req-f1a0545c-3c11-4534-8114-822237c146f5 tempest-ProjectMemberTests-1705931170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:09:20 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[74366c42-f657-4c8b-bee6-a2193d61ba39]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f1a0545c-3c11-4534-8114-822237c146f5 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:20 devstack sudo[108417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e Nov 04 19:09:20 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:20 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f1a0545c-3c11-4534-8114-822237c146f5 tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e" returned: 0 in 0.349s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:20 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f1a0545c-3c11-4534-8114-822237c146f5 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e.ecaa8918-0fa7-41e3-8c5f-7d8c1204ff02 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:20 devstack sudo[108422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e.ecaa8918-0fa7-41e3-8c5f-7d8c1204ff02 Nov 04 19:09:20 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:21 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f1a0545c-3c11-4534-8114-822237c146f5 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e.ecaa8918-0fa7-41e3-8c5f-7d8c1204ff02" returned: 0 in 0.328s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f1a0545c-3c11-4534-8114-822237c146f5 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e.ecaa8918-0fa7-41e3-8c5f-7d8c1204ff02 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:21 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e.ecaa8918-0fa7-41e3-8c5f-7d8c1204ff02 Nov 04 19:09:21 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:21 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:21 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-f1a0545c-3c11-4534-8114-822237c146f5 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e.ecaa8918-0fa7-41e3-8c5f-7d8c1204ff02" returned: 0 in 0.238s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:21 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f1a0545c-3c11-4534-8114-822237c146f5 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-ecaa8918-0fa7-41e3-8c5f-7d8c1204ff02" released by "_delete_snapshot" :: held 1.366s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:21 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f1a0545c-3c11-4534-8114-822237c146f5 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-2043c507-d3e4-41d4-9006-dcb4bf29d54e" released by "delete_snapshot" :: held 1.386s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:21 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-f1a0545c-3c11-4534-8114-822237c146f5 tempest-ProjectMemberTests-1705931170 None] Created reservations ['925ddecf-b2d5-4530-9ae6-23b776f7ab9a', '822ba540-844d-4c96-89f2-f2b355672c90', 'f51bfd83-1859-4c33-ad2b-a3e10b849f14', '44fbfa47-ab7b-47bc-82b5-92d502c3b4ee'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:09:21 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-f1a0545c-3c11-4534-8114-822237c146f5 tempest-ProjectMemberTests-1705931170 None] Delete snapshot completed successfully. Nov 04 19:09:21 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-f1a0545c-3c11-4534-8114-822237c146f5 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-ecaa8918-0fa7-41e3-8c5f-7d8c1204ff02-delete_snapshot" released by "delete_snapshot" :: held 1.510s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:22 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-99484598-e5da-420e-97dd-8a1c19c5f135 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-2043c507-d3e4-41d4-9006-dcb4bf29d54e-delete_volume" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:22 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-99484598-e5da-420e-97dd-8a1c19c5f135 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-2043c507-d3e4-41d4-9006-dcb4bf29d54e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:22 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-99484598-e5da-420e-97dd-8a1c19c5f135 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "cinder-quobyte-2043c507-d3e4-41d4-9006-dcb4bf29d54e" by "delete_volume" {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:22 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-99484598-e5da-420e-97dd-8a1c19c5f135 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-2043c507-d3e4-41d4-9006-dcb4bf29d54e" acquired by "delete_volume" :: waited 0.015s {{(pid=87119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:22 devstack cinder-volume[87119]: DEBUG oslo.privsep.daemon [-] privsep: reply[42862d2e-8c68-41e8-9ba0-7ce0c4d28159]: (4, 'qcow2') {{(pid=88242) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-99484598-e5da-420e-97dd-8a1c19c5f135 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:22 devstack sudo[108431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e Nov 04 19:09:22 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:22 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-99484598-e5da-420e-97dd-8a1c19c5f135 tempest-ProjectMemberTests-1705931170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e" returned: 0 in 0.350s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-99484598-e5da-420e-97dd-8a1c19c5f135 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:22 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e Nov 04 19:09:22 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:22 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-99484598-e5da-420e-97dd-8a1c19c5f135 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7/volume-2043c507-d3e4-41d4-9006-dcb4bf29d54e" returned: 0 in 0.237s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:22 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-99484598-e5da-420e-97dd-8a1c19c5f135 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-quobyte-2043c507-d3e4-41d4-9006-dcb4bf29d54e" released by "delete_volume" :: held 0.644s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:22 devstack cinder-volume[87119]: DEBUG cinder.quota [None req-99484598-e5da-420e-97dd-8a1c19c5f135 tempest-ProjectMemberTests-1705931170 None] Created reservations ['4993b4c5-71f5-4d3e-96f9-f27853f9c99d', 'e20e7ae2-3740-4913-885c-adb86f18004b', '3e88fdcf-c9cb-4f3d-9096-50b329e174a8', '4644f90a-bca7-412f-bf29-fad2091c7bfa'] {{(pid=87119) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:09:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-99484598-e5da-420e-97dd-8a1c19c5f135 tempest-ProjectMemberTests-1705931170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-99484598-e5da-420e-97dd-8a1c19c5f135 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:22 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-99484598-e5da-420e-97dd-8a1c19c5f135 tempest-ProjectMemberTests-1705931170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:09:22 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-99484598-e5da-420e-97dd-8a1c19c5f135 tempest-ProjectMemberTests-1705931170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:09:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-99484598-e5da-420e-97dd-8a1c19c5f135 tempest-ProjectMemberTests-1705931170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:22 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-99484598-e5da-420e-97dd-8a1c19c5f135 tempest-ProjectMemberTests-1705931170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:22 devstack sudo[108439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:09:22 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:23 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:23 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-99484598-e5da-420e-97dd-8a1c19c5f135 tempest-ProjectMemberTests-1705931170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.228s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:23 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-99484598-e5da-420e-97dd-8a1c19c5f135 tempest-ProjectMemberTests-1705931170 None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:09:23 devstack cinder-volume[87119]: INFO cinder.volume.manager [None req-99484598-e5da-420e-97dd-8a1c19c5f135 tempest-ProjectMemberTests-1705931170 None] Deleted volume successfully. Nov 04 19:09:23 devstack cinder-volume[87119]: DEBUG cinder.coordination [None req-99484598-e5da-420e-97dd-8a1c19c5f135 tempest-ProjectMemberTests-1705931170 None] Lock "cinder-2043c507-d3e4-41d4-9006-dcb4bf29d54e-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=87119) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:09:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280': None} {{(pid=87119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:09:25 devstack cinder-volume[87119]: DEBUG cinder.volume.drivers.quobyte [None req-30619644-0e36-4452-abff-44639289c75d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6e2c829b-0316-460f-984b-526fde2be280'] {{(pid=87119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:09:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.lockutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:25 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7 Nov 04 19:09:25 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:25 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:25 devstack cinder-volume[87119]: DEBUG oslo_concurrency.processutils [None req-30619644-0e36-4452-abff-44639289c75d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bee218a0a653bbeb713ad98e7d44b7c7" returned: 0 in 0.247s {{(pid=87119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:25 devstack cinder-volume[87119]: DEBUG cinder.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] Notifying Schedulers of capabilities ... {{(pid=87119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:09:25 devstack cinder-volume[87119]: DEBUG oslo_service.periodic_task [None req-30619644-0e36-4452-abff-44639289c75d None None] Running periodic task VolumeManager._thread_info {{(pid=87119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:09:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread count: 28 {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:09:25 devstack cinder-volume[87119]: DEBUG cinder.volume.manager [None req-30619644-0e36-4452-abff-44639289c75d None None] thread info: [<_MainThread(MainThread, started 130247852032128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:09:32 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:INSERT=20,cinder:UPDATE=67,cinder:SELECT=48,cinder:DELETE=2 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:09:33 devstack cinder-volume[87119]: DEBUG dbcounter [-] [87119] Writing DB stats cinder:SELECT=54,cinder:INSERT=18,cinder:UPDATE=69,cinder:DELETE=8 {{(pid=87119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}